-- Logs begin at Mon 2021-05-31 15:41:11 UTC, end at Mon 2021-05-31 16:36:24 UTC. --
May 31 16:11:48.112705 dv-cinder-793814-1-iscsi systemd[1]: Started Devstack devstack@q-svc.service.
May 31 16:11:49.100518 dv-cinder-793814-1-iscsi neutron-server[91656]: Beware of the coming changes in the project packaging
May 31 16:11:49.101146 dv-cinder-793814-1-iscsi neutron-server[91656]: https://github.com/svinota/pyroute2/discussions/786
May 31 16:11:50.585193 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.common.config [-] Logging enabled!
May 31 16:11:50.585886 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev246
May 31 16:11:50.585983 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=91656) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
May 31 16:11:50.589148 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.common.config [-] Logging enabled!
May 31 16:11:50.589406 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev246
May 31 16:11:50.589746 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=91656) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
May 31 16:11:50.590680 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 31 16:11:50.590912 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 31 16:11:50.591268 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 31 16:11:50.591513 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 31 16:11:50.591741 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 31 16:11:50.592061 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] allow_bulk                     = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.592354 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] allow_overlapping_ips          = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.592647 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] api_extensions_path            =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.592877 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] api_paste_config               = api-paste.ini {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.593171 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] api_workers                    = 2 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.593459 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] auth_strategy                  = keystone {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.593768 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] backlog                        = 4096 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.594052 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.594347 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] bind_host                      = 0.0.0.0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.594629 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] bind_port                      = 9696 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.594908 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] client_socket_timeout          = 900 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.595188 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] config_dir                     = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.595416 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.595695 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] config_source                  = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.595980 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] control_exchange               = neutron {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.596267 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] core_plugin                    = ml2 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.596491 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] debug                          = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.596770 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] default_availability_zones     = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.597194 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.597633 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] dhcp_agent_notification        = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.597915 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] dhcp_lease_duration            = 86400 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.598205 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] dns_domain                     = openstacklocal {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.598483 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] enable_traditional_dhcp        = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.598755 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] external_dns_driver            = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.599030 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] filter_validation              = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.599443 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] global_physnet_mtu             = 1500 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.599854 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] host                           = dv-cinder-793814-1-iscsi {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.600255 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] http_retries                   = 3 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.600553 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] instance_format                = [instance: %(uuid)s]  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.600843 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.601130 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ipam_driver                    = internal {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.601413 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ipv6_pd_enabled                = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.601720 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] log_config_append              = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.602007 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.602280 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] log_dir                        = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.602554 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] log_file                       = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.602832 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] log_rotate_interval            = 1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.603119 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] log_rotate_interval_type       = days {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.603402 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] log_rotation_type              = none {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.603702 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.603928 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.604152 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.604442 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.604725 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.605002 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] max_dns_nameservers            = 5 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.605276 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] max_header_line                = 16384 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.605570 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] max_logfile_count              = 30 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.605847 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] max_logfile_size_mb            = 200 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.606119 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] max_subnet_host_routes         = 20 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.606386 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] network_link_prefix            = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.606669 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.606953 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.607234 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] pagination_max_limit           = -1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.607506 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] periodic_fuzzy_delay           = 5 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.607779 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] periodic_interval              = 40 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.608047 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] publish_errors                 = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.608317 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] rate_limit_burst               = 0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.608599 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] rate_limit_except_level        = CRITICAL {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.608871 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] rate_limit_interval            = 0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.609143 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] retry_until_window             = 30 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.609413 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] rpc_response_max_timeout       = 600 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.609724 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] rpc_state_report_workers       = 0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.609994 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] rpc_workers                    = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.610266 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] send_events_interval           = 2 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.610565 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.610848 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] setproctitle                   = on {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.611129 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] state_path                     = /opt/stack/data/neutron {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.611411 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] syslog_log_facility            = LOG_USER {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.611686 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] tcp_keepidle                   = 600 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.611966 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] transport_url                  = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.612235 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] use_eventlog                   = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.612506 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] use_journal                    = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.612775 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] use_json                       = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.613046 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] use_ssl                        = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.613313 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] use_stderr                     = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.613613 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] use_syslog                     = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.613884 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] vlan_transparent               = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.614171 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] watch_log_file                 = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.614433 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] wsgi_default_pool_size         = 100 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.614700 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] wsgi_keep_alive                = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.615590 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:50.615891 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.616186 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.616484 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] profiler.connection_string     = messaging:// {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.616768 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] profiler.enabled               = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.617061 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] profiler.es_doc_type           = notification {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.617342 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] profiler.es_scroll_size        = 10000 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.617650 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] profiler.es_scroll_time        = 2m {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.617930 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] profiler.filter_error_trace    = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.618218 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] profiler.hmac_keys             = SECRET_KEY {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.618503 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.618792 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] profiler.socket_timeout        = 0.1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.619070 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy      = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.619359 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.619642 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope      = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.619935 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.620239 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.620533 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.620824 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.621352 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.621649 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.621922 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.622200 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.622485 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] nova.auth_section              = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.622777 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] nova.auth_type                 = password {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.623068 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.623340 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] nova.certfile                  = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.623617 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] nova.collect_timing            = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.623907 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] nova.endpoint_type             = public {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.624185 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] nova.insecure                  = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.624455 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] nova.keyfile                   = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.624732 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] nova.live_migration_events     = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.625021 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] nova.region_name               = RegionOne {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.625300 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] nova.split_loggers             = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.625593 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] nova.timeout                   = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.625878 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] placement.auth_section         = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.626155 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] placement.auth_type            = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.626426 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] placement.cafile               = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.626695 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] placement.certfile             = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.626970 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] placement.collect_timing       = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.627257 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] placement.endpoint_type        = public {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.627531 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] placement.insecure             = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.627800 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] placement.keyfile              = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.628070 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] placement.region_name          = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.628344 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] placement.split_loggers        = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.628615 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] placement.timeout              = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.628898 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.auth_section            = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.629173 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.auth_type               = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.629444 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.cafile                  = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.629742 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.certfile                = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.630019 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.collect_timing          = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.630290 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.connect_retries         = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.631118 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.connect_retry_delay     = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.631396 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.enable_notifications    = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.631668 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.endpoint_override       = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.631945 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.insecure                = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.632215 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.interface               = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.632763 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.keyfile                 = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.633052 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.max_version             = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.633322 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.min_version             = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.633620 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.region_name             = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.633891 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.service_name            = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.634162 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.service_type            = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.634437 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.split_loggers           = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.634708 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.status_code_retries     = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.634978 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.635247 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.timeout                 = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.635517 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.valid_interfaces        = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.635786 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ironic.version                 = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.636072 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.636366 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.636641 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.636917 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.637193 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.637469 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.637768 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.638042 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.638320 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.638597 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.638869 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.639158 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.639438 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.639728 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.639987 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.640266 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.640555 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.640834 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.641113 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.641386 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.641687 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.641976 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.642259 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl      = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.642550 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.642839 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.643127 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.643416 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.643708 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.643988 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.644297 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.644576 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:50.644799 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 31 16:11:50.645044 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=91656) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}}
May 31 16:11:50.999559 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=91656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:11:50.999764 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=91656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:11:51.000050 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=91656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:11:51.000536 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.manager [-] Loading core plugin: ml2
May 31 16:11:51.397009 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.397301 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.397596 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.398800 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.399074 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.399341 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.434881 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.435160 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.435428 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.448966 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.449249 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.449547 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.480634 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.480917 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.481194 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.517478 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.517784 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.518055 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.754481 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7f14285edee0> agent after_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.755108 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7f14285edee0> agent after_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.755108 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _add_segment_host_mapping_for_segment at 0x7f14285ede50> segment precommit_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.755281 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _delete_segments_for_network at 0x7f14285eddc0> network precommit_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.756567 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _prevent_segment_delete_with_port_bound at 0x7f14286209d0> segment before_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.882785 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._before_network_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> network before_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.883103 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function DVRDbMixin._delete_mac_associated_with_agent at 0x7f14286410d0> agent before_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.883387 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_net of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> network before_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.883663 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> port before_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.883934 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> port before_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.884245 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> segment precommit_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.884503 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> segment precommit_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.884759 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> segment after_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.885016 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> segment after_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.885295 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> network after_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.885573 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> network precommit_delete 0 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.885841 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._port_provisioned of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> port provisioning_complete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.886106 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_create of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> rbac-policy before_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.886368 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_delete of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> rbac-policy after_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.886647 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._retry_binding_revived_agents of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> agent after_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.886920 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> subnet after_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.888323 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> subnet precommit_delete 0 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.888618 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> rbac-policy before_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.888892 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> rbac-policy before_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.889188 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> segment_host_mapping after_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.889568 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> port after_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.889839 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> port after_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.890099 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> port after_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.890388 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> rbac-policy before_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.890644 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> rbac-policy before_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.890896 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f1428debe50>> rbac-policy before_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.891283 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=91656) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 31 16:11:51.891525 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=91656) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 31 16:11:51.891765 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=91656) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 31 16:11:51.892000 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=91656) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 31 16:11:51.892234 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=91656) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 31 16:11:51.892469 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=91656) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 31 16:11:51.892839 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve']
May 31 16:11:51.896084 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1']
May 31 16:11:51.900522 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete
May 31 16:11:51.904310 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(800, 849)])])
May 31 16:11:51.905974 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']
May 31 16:11:51.906423 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'])
May 31 16:11:51.906776 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan']
May 31 16:11:51.907161 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security']
May 31 16:11:51.910140 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security']
May 31 16:11:51.910398 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security']
May 31 16:11:51.910746 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv']
May 31 16:11:51.937984 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa']
May 31 16:11:51.938445 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.qos.drivers.openvswitch.driver.OVSDriver object at 0x7f1428570940>> qos_plugin after_init 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.938744 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=91656) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}}
May 31 16:11:51.939108 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.logapi.drivers.openvswitch.driver.OVSDriver object at 0x7f1428570580>> logging-plugin after_init 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.940456 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=91656) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}}
May 31 16:11:51.940743 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv']
May 31 16:11:51.940992 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv']
May 31 16:11:51.944776 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7f14283170a0>> floatingip before_response 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:51.945058 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7f14283170a0>> port before_response 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.022960 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat'
May 31 16:11:52.023141 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete
May 31 16:11:52.023382 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve'
May 31 16:11:52.023766 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)]
May 31 16:11:52.054849 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_db.sqlalchemy.engines [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91656) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
May 31 16:11:52.392735 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.managers [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Initializing driver for type 'gre'
May 31 16:11:52.393314 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] gre ID ranges: [(1, 1000)]
May 31 16:11:52.446735 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.managers [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Initializing driver for type 'local'
May 31 16:11:52.447154 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.managers [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Initializing driver for type 'vlan'
May 31 16:11:52.459824 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] VlanTypeDriver initialization complete
May 31 16:11:52.460309 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.managers [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Initializing driver for type 'vxlan'
May 31 16:11:52.460813 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] vxlan ID ranges: [(1, 1000)]
May 31 16:11:52.513273 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.managers [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Initializing extension driver 'port_security'
May 31 16:11:52.513645 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.extensions.port_security [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] PortSecurityExtensionDriver initialization complete
May 31 16:11:52.513975 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.managers [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Initializing mechanism driver 'openvswitch'
May 31 16:11:52.514303 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.managers [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Initializing mechanism driver 'hyperv'
May 31 16:11:52.520870 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.plugins.ml2.plugin [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=91656) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:11:52.521688 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f1428402670>> port after_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.522062 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f1428402670>> port after_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.522421 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f1428402670>> port after_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.522805 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f14284028b0>> subnet after_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.523212 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f14284028b0>> subnet after_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.523561 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f14284028b0>> subnet after_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.523945 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f1427e6d520>> network after_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.524890 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f1427e6d520>> network after_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.525240 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f1427e6d520>> network after_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.526017 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f1427e6d730>> security_group after_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.526422 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f1427e6d730>> security_group after_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.526820 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f1427e6d730>> security_group after_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.527259 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f1427e6d970>> security_group_rule after_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.527659 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f1427e6d970>> security_group_rule after_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.528077 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f1427e6d970>> security_group_rule after_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.528539 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f1427e6dc40>> address_group after_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.528972 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f1427e6dc40>> address_group after_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.529400 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f1427e6dc40>> address_group after_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.529824 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] ML2 OVO RPC backend initialized. {{(pid=91656) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:160}}
May 31 16:11:52.530601 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_created of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f1427e6dbb0>> router_interface after_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.530991 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_deleted of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f1427e6dbb0>> router_interface after_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.531442 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f1427e6dbb0>> network before_response 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.531841 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f1427e6dbb0>> networks before_response 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.532250 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f1427e6dbb0>> port before_response 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.532638 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f1427e6dbb0>> ports before_response 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.533015 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f1427e6dbb0>> subnet before_response 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.533389 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f1427e6dbb0>> subnets before_response 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.533849 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f1427e6dbb0>> network after_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.534274 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f1427e6dbb0>> network after_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.534649 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f1427e6dbb0>> network after_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.535028 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f1427e6dbb0>> port after_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.535404 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f1427e6dbb0>> port after_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.535783 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f1427e6dbb0>> port after_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.536161 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f1427e6dbb0>> subnet after_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.536548 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f1427e6dbb0>> subnet after_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.537426 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f1427e6dbb0>> subnet after_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.538090 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.plugin [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Modular L2 Plugin initialization complete
May 31 16:11:52.538472 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading services supported by the core plugin {{(pid=91656) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}}
May 31 16:11:52.538849 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.plugins.ml2.managers [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Got port-security extension from driver 'port_security'
May 31 16:11:52.539361 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.extensions.vlantransparent [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Disabled vlantransparent extension.
May 31 16:11:52.539903 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=91656) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}}
May 31 16:11:52.540251 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading Plugin: router
May 31 16:11:52.577920 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DVRResourceOperationHandler._add_csnat_on_interface_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> router_interface before_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.578307 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._after_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> router after_create 55549900 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.578674 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._before_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> router before_create 55549900 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.579033 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> router_interface before_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.579394 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DVRResourceOperationHandler._cleanup_after_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> router_interface after_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.579741 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._cleanup_ha_network of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> router after_delete 55549900 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.580091 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DVRResourceOperationHandler._create_dvr_floating_gw_port of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> floatingip after_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.580450 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> router after_create 55549900 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.580791 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> router after_update 55549900 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.581133 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_distributed_port_bindings_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> router after_update 55549900 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.581473 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_dvr_internal_ports of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> router_gateway after_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.581845 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> router after_update 55549900 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.582243 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DVRResourceOperationHandler._handle_distributed_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> router precommit_update 55549900 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.582606 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <function L3RpcNotifierMixin._notify_gateway_port_ip_changed at 0x7f14283c7940> port after_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.582946 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <function L3RpcNotifierMixin._notify_routers_callback at 0x7f14283c7a60> port after_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.583282 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnet_gateway_ip_update at 0x7f14283c79d0> subnet after_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.583630 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnetpool_address_scope_update at 0x7f14283c7820> subnetpool_address_scope after_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.583966 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method L3_NAT_dbonly_mixin._precommit_delete_port_callback of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> port precommit_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.584305 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._precommit_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> router precommit_create 55549900 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.584640 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback at 0x7f14283bf430> port before_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.584975 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method RouterAvailabilityZoneMixin._process_az_request of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> router precommit_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.585323 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._reconfigure_ha_resources of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> router after_update 55549900 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.585690 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._release_router_vr_id of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> router precommit_delete 55549900 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.586033 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DVRResourceOperationHandler._set_distributed_flag of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> router precommit_create 55549900 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.586384 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> router_interface after_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.586719 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._validate_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> router precommit_update 55549900 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.587081 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f1427e75130>> network after_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.587898 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Tracking information for resource: router configured {{(pid=91656) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 31 16:11:52.588219 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Tracking information for resource: floatingip configured {{(pid=91656) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 31 16:11:52.593060 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.db.l3_agentschedulers_db [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled.
May 31 16:11:52.593665 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <function _notify_l3_agent_port_update at 0x7f1427deddc0> port after_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.594019 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <function _notify_l3_agent_new_port at 0x7f1427dedca0> port after_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.594367 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <function _notify_port_delete at 0x7f1427dedd30> port after_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.594711 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <function _notify_l3_agent_ha_port_update at 0x7f1427deb0d0> port after_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.595480 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DriverController._check_router_request of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f1427e0b910>> router before_create 55550100 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.595838 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DriverController._clear_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f1427e0b910>> router precommit_delete 55550100 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.596193 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DriverController._set_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f1427e0b910>> router precommit_create 55550100 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.596544 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method DriverController._update_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f1427e0b910>> router precommit_update 55550100 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.601545 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.services.provider_configuration [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Service providers = [] {{(pid=91656) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}}
May 31 16:11:52.601928 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.db.servicetype_db [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=91656) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}}
May 31 16:11:52.604815 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.services.service_base [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=91656) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 31 16:11:52.605159 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.services.service_base [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=91656) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 31 16:11:52.605498 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.services.service_base [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=91656) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 31 16:11:52.606396 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.services.service_base [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=91656) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 31 16:11:52.606763 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.services.service_base [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Default provider is not specified for service type L3_ROUTER_NAT
May 31 16:11:52.607310 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=91656) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 31 16:11:52.607634 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin
May 31 16:11:52.618696 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=91656) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 31 16:11:52.619023 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading Plugin: auto_allocate
May 31 16:11:52.624979 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7f1427e343a0> network precommit_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.625348 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7f1427e343a0> network precommit_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.625899 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=91656) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 31 16:11:52.626216 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading Plugin: tag
May 31 16:11:52.633066 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=91656) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 31 16:11:52.633391 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading Plugin: timestamp
May 31 16:11:52.637177 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=91656) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 31 16:11:52.637504 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading Plugin: network_ip_availability
May 31 16:11:52.642682 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f1427e27f70>> rbac-policy before_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.643099 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f1427e27f70>> rbac-policy before_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.643402 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f1427e27f70>> rbac-policy before_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.644115 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=91656) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 31 16:11:52.644431 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading Plugin: flavors
May 31 16:11:52.649461 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=91656) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 31 16:11:52.649816 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading Plugin: revisions
May 31 16:11:52.654760 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=91656) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 31 16:11:52.655145 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_concurrency.lockutils [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 1.655s {{(pid=91656) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:11:52.655870 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=91656) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}}
May 31 16:11:52.656196 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Initializing extension manager.
May 31 16:11:52.656691 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: __init__.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.657024 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: __pycache__ {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.657353 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.657714 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: address_group.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.658459 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.659023 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: address-group
May 31 16:11:52.659342 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: address_scope.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.660031 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.660530 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: address-scope
May 31 16:11:52.660847 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: admin_state_down_before_update.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.662338 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.662891 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: router-admin-state-down-before-update
May 31 16:11:52.663210 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: agent.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.663894 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.664396 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: agent
May 31 16:11:52.664711 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: agent_resources_synced.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.665638 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.666137 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: agent-resources-synced
May 31 16:11:52.666452 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: allowedaddresspairs.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.668195 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.668703 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: allowed-address-pairs
May 31 16:11:52.669023 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: auto_allocated_topology.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.670115 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.670620 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: auto-allocated-topology
May 31 16:11:52.670940 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: availability_zone.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.671618 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.672115 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: availability_zone
May 31 16:11:52.672435 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: availability_zone_filter.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.673319 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.673841 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: availability_zone_filter
May 31 16:11:52.674160 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: data_plane_status.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.675044 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.675536 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension data-plane-status not supported by any of loaded plugins
May 31 16:11:52.675849 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: default_subnetpools.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.676732 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.677294 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: default-subnetpools
May 31 16:11:52.678189 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: dhcpagentscheduler.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.678980 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.679481 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: dhcp_agent_scheduler
May 31 16:11:52.679797 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: dns.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.680685 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.681178 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension dns-integration not supported by any of loaded plugins
May 31 16:11:52.681494 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: dns_domain_ports.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.682407 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.682902 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension dns-domain-ports not supported by any of loaded plugins
May 31 16:11:52.683217 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: dvr.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.683867 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.684371 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: dvr
May 31 16:11:52.684686 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: empty_string_filtering.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.685584 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.686082 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: empty-string-filtering
May 31 16:11:52.686399 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.687281 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.687771 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins
May 31 16:11:52.688089 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.688972 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.689464 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins
May 31 16:11:52.689804 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: external_net.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.690680 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.691178 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: external-net
May 31 16:11:52.691493 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: extra_dhcp_opt.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.692362 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.692900 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: extra_dhcp_opt
May 31 16:11:52.693293 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: extraroute.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.694254 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.694755 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: extraroute
May 31 16:11:52.695070 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: extraroute_atomic.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.696086 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.696589 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: extraroute-atomic
May 31 16:11:52.696903 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: filter_validation.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.697569 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.698069 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: filter-validation
May 31 16:11:52.698381 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: fip_pf_description.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.699443 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.699940 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins
May 31 16:11:52.700259 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: fip_port_details.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.701146 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.701670 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: fip-port-details
May 31 16:11:52.701987 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: flavors.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.703203 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.703706 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: flavors
May 31 16:11:52.704026 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.705703 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.706212 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins
May 31 16:11:52.706872 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: floatingip_pools.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.707565 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.708064 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: floatingip-pools
May 31 16:11:52.708384 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: ip_allocation.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.709356 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.709891 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension ip_allocation not supported by any of loaded plugins
May 31 16:11:52.710211 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.711104 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.711603 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: ip-substring-filtering
May 31 16:11:52.711923 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: l2_adjacency.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.712811 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.713304 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension l2_adjacency not supported by any of loaded plugins
May 31 16:11:52.713652 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: l3.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.714612 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.715119 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: router
May 31 16:11:52.715439 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: l3_conntrack_helper.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.717692 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.718213 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension l3-conntrack-helper not supported by any of loaded plugins
May 31 16:11:52.718536 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.719433 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.719941 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: ext-gw-mode
May 31 16:11:52.720259 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.721148 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.721683 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: l3-ha
May 31 16:11:52.722000 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: l3_flavors.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.722889 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.723384 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: l3-flavors
May 31 16:11:52.723702 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.725207 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.725730 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: l3-port-ip-change-not-allowed
May 31 16:11:52.726044 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: l3agentscheduler.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.727072 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.727578 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: l3_agent_scheduler
May 31 16:11:52.727900 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: logging.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.729398 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.729946 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension logging not supported by any of loaded plugins
May 31 16:11:52.730279 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: metering.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.731003 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.731577 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: metering
May 31 16:11:52.731901 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.732979 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.733483 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: metering_source_and_destination_fields
May 31 16:11:52.733827 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: multiprovidernet.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.734879 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.735379 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: multi-provider
May 31 16:11:52.735699 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: netmtu.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.736586 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.737082 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: net-mtu
May 31 16:11:52.737403 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: netmtu_writable.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.738318 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.738815 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: net-mtu-writable
May 31 16:11:52.739134 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: network_availability_zone.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.740337 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.740846 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: network_availability_zone
May 31 16:11:52.741161 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: network_ip_availability.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.742277 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.742780 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: network-ip-availability
May 31 16:11:52.743100 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: network_segment_range.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.743850 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.744347 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension network-segment-range not supported by any of loaded plugins
May 31 16:11:52.744666 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: pagination.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.745670 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.745998 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: pagination
May 31 16:11:52.746571 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: port_device_profile.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.747452 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.747952 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: port-device-profile
May 31 16:11:52.748268 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.749165 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.749694 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: port-mac-address-regenerate
May 31 16:11:52.750012 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.750896 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.751393 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: port-numa-affinity-policy
May 31 16:11:52.751709 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: port_resource_request.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.752594 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.753085 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension port-resource-request not supported by any of loaded plugins
May 31 16:11:52.753401 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: portbindings.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.754592 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.755114 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: binding
May 31 16:11:52.755424 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: portbindings_extended.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.756860 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.757365 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: binding-extended
May 31 16:11:52.757718 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: portsecurity.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.758605 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.759106 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: port-security
May 31 16:11:52.759427 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: project_id.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.760363 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.760685 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: project-id
May 31 16:11:52.761003 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: providernet.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.761921 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.762418 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: provider
May 31 16:11:52.762736 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: qos.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.766217 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.766733 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension qos not supported by any of loaded plugins
May 31 16:11:52.767060 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.768277 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.768781 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins
May 31 16:11:52.769107 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.770035 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.770542 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins
May 31 16:11:52.770861 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: qos_default.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.772546 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.773054 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension qos-default not supported by any of loaded plugins
May 31 16:11:52.773377 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: qos_fip.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.774036 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.774537 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension qos-fip not supported by any of loaded plugins
May 31 16:11:52.774856 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: qos_gateway_ip.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.775759 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.776256 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension qos-gateway-ip not supported by any of loaded plugins
May 31 16:11:52.776576 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: qos_port_network_policy.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.777461 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.777995 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension qos-port-network-policy not supported by any of loaded plugins
May 31 16:11:52.778317 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: qos_rule_type_details.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.779218 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.779716 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension qos-rule-type-details not supported by any of loaded plugins
May 31 16:11:52.780035 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: qos_rules_alias.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.781065 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.781597 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension qos-rules-alias not supported by any of loaded plugins
May 31 16:11:52.785304 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: quotasv2.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.785304 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.785304 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: quotas
May 31 16:11:52.785304 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: quotasv2_detail.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.785304 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.785749 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: quota_details
May 31 16:11:52.785920 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: rbac.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.787619 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.788247 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: rbac-policies
May 31 16:11:52.788569 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: rbac_address_group.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.789487 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.790015 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: rbac-address-group
May 31 16:11:52.790334 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: rbac_address_scope.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.791226 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.791726 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: rbac-address-scope
May 31 16:11:52.792043 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: rbac_security_groups.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.792928 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.793426 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: rbac-security-groups
May 31 16:11:52.793776 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: rbac_subnetpool.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.794661 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.795159 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: rbac-subnetpool
May 31 16:11:52.795475 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: revisionifmatch.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.796372 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.796866 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: revision-if-match
May 31 16:11:52.797179 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: revisions.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.798295 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.798800 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: standard-attr-revisions
May 31 16:11:52.799119 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: router_availability_zone.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.799773 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.800273 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: router_availability_zone
May 31 16:11:52.800588 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: routerservicetype.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.801506 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.802037 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension router-service-type not supported by any of loaded plugins
May 31 16:11:52.802490 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.803350 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.803851 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: security-groups-normalized-cidr
May 31 16:11:52.804168 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: security_groups_port_filtering.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.805066 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.805591 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: port-security-groups-filtering
May 31 16:11:52.805914 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.806804 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.807298 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: security-groups-remote-address-group
May 31 16:11:52.807614 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: securitygroup.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.817383 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.817959 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: security-group
May 31 16:11:52.818286 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: segment.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.819064 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.819564 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension segment not supported by any of loaded plugins
May 31 16:11:52.819882 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.820790 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.821286 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins
May 31 16:11:52.821635 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: servicetype.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.822734 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.823247 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: service-type
May 31 16:11:52.823565 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: sorting.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.824526 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.824853 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: sorting
May 31 16:11:52.825173 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: standard_attr_segment.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.826110 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.826613 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension standard-attr-segment not supported by any of loaded plugins
May 31 16:11:52.826932 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: standardattrdescription.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.827566 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.828060 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: standard-attr-description
May 31 16:11:52.828376 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: stateful_security_group.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.829267 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.829796 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: stateful-security-group
May 31 16:11:52.830113 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: stdattrs_common.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.830676 dv-cinder-793814-1-iscsi neutron-server[91656]: WARNING neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py
May 31 16:11:52.830990 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.831958 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.832457 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins
May 31 16:11:52.832770 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: subnet_onboard.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.834615 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.835131 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: subnet_onboard
May 31 16:11:52.835455 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.836377 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.836877 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins
May 31 16:11:52.837195 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: subnet_service_types.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.838133 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.838721 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: subnet-service-types
May 31 16:11:52.839038 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: subnetallocation.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.840189 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.841735 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: subnet_allocation
May 31 16:11:52.842068 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.842763 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.843270 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: subnetpool-prefix-ops
May 31 16:11:52.843585 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.844496 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.844990 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins
May 31 16:11:52.845303 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: tagging.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.846424 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.846927 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: standard-attr-tag
May 31 16:11:52.847246 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: timestamp.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.848422 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.848928 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loaded extension: standard-attr-timestamp
May 31 16:11:52.849974 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: trunk.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.851040 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.851544 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension trunk not supported by any of loaded plugins
May 31 16:11:52.851866 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: trunk_details.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.852758 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.853257 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension trunk-details not supported by any of loaded plugins
May 31 16:11:52.853674 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: uplink_status_propagation.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.854850 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.855353 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension uplink-status-propagation not supported by any of loaded plugins
May 31 16:11:52.855671 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Loading extension file: vlantransparent.py {{(pid=91656) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 31 16:11:52.856333 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=91656) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 31 16:11:52.856828 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extension vlan-transparent not supported by any of loaded plugins
May 31 16:11:52.859324 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Creating instance of TrackedResource for resource:network
May 31 16:11:52.860063 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Creating instance of TrackedResource for resource:subnet
May 31 16:11:52.862000 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Creating instance of TrackedResource for resource:subnetpool
May 31 16:11:52.862622 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Creating instance of TrackedResource for resource:port
May 31 16:11:52.863885 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.v2.resource_helper [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91656) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 31 16:11:52.864315 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.v2.resource_helper [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Service FLAVORS assigned prefix:  {{(pid=91656) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 31 16:11:52.864979 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.v2.resource_helper [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91656) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 31 16:11:52.865431 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.v2.resource_helper [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91656) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 31 16:11:52.865871 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Creating instance of TrackedResource for resource:router
May 31 16:11:52.866523 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Creating instance of TrackedResource for resource:floatingip
May 31 16:11:52.867229 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.v2.resource_helper [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Service METERING assigned prefix: /metering {{(pid=91656) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 31 16:11:52.868651 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f1427d0a4c0>> rbac-policy before_create 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.869013 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f1427d0a4c0>> rbac-policy before_update 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.869359 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f1427d0a4c0>> rbac-policy before_delete 55550000 {{(pid=91656) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:11:52.870545 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Creating instance of CountableResource for resource:rbac_policy
May 31 16:11:52.870984 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Creating instance of TrackedResource for resource:security_group
May 31 16:11:52.871950 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Creating instance of TrackedResource for resource:security_group_rule
May 31 16:11:52.872683 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.v2.resource_helper [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Service CORE assigned prefix:  {{(pid=91656) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 31 16:11:52.873007 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Creating instance of TrackedResource for resource:subnetpool
May 31 16:11:52.873339 dv-cinder-793814-1-iscsi neutron-server[91656]: WARNING neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] subnetpool is already registered
May 31 16:11:52.873983 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.v2.resource_helper [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Service CORE assigned prefix:  {{(pid=91656) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 31 16:11:52.874304 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Creating instance of TrackedResource for resource:subnetpool
May 31 16:11:52.874621 dv-cinder-793814-1-iscsi neutron-server[91656]: WARNING neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] subnetpool is already registered
May 31 16:11:52.877421 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.v2.resource_helper [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91656) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 31 16:11:52.877886 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.v2.resource_helper [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Service FLAVORS assigned prefix:  {{(pid=91656) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 31 16:11:52.878478 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.v2.resource_helper [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91656) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 31 16:11:52.878897 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.v2.resource_helper [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91656) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 31 16:11:52.879228 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Creating instance of TrackedResource for resource:router
May 31 16:11:52.879553 dv-cinder-793814-1-iscsi neutron-server[91656]: WARNING neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] router is already registered
May 31 16:11:52.880200 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Creating instance of TrackedResource for resource:floatingip
May 31 16:11:52.880570 dv-cinder-793814-1-iscsi neutron-server[91656]: WARNING neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] floatingip is already registered
May 31 16:11:52.881213 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.v2.resource_helper [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Service METERING assigned prefix: /metering {{(pid=91656) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 31 16:11:52.881962 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Creating instance of CountableResource for resource:rbac_policy
May 31 16:11:52.882287 dv-cinder-793814-1-iscsi neutron-server[91656]: WARNING neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] rbac_policy is already registered
May 31 16:11:52.882849 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Creating instance of TrackedResource for resource:security_group
May 31 16:11:52.883186 dv-cinder-793814-1-iscsi neutron-server[91656]: WARNING neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] security_group is already registered
May 31 16:11:52.883783 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Creating instance of TrackedResource for resource:security_group_rule
May 31 16:11:52.884116 dv-cinder-793814-1-iscsi neutron-server[91656]: WARNING neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] security_group_rule is already registered
May 31 16:11:52.884817 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.v2.resource_helper [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Service CORE assigned prefix:  {{(pid=91656) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 31 16:11:52.885139 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Creating instance of TrackedResource for resource:subnetpool
May 31 16:11:52.885459 dv-cinder-793814-1-iscsi neutron-server[91656]: WARNING neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] subnetpool is already registered
May 31 16:11:52.886091 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.v2.resource_helper [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Service CORE assigned prefix:  {{(pid=91656) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 31 16:11:52.886412 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Creating instance of TrackedResource for resource:subnetpool
May 31 16:11:52.886730 dv-cinder-793814-1-iscsi neutron-server[91656]: WARNING neutron.quota.resource_registry [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] subnetpool is already registered
May 31 16:11:52.887383 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: extensions {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.888958 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: address-groups {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.890664 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: address-scopes {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.891883 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: agents {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.893069 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: auto-allocated-topology {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.894435 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: availability_zones {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.895741 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: dhcp-networks {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.897756 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: dhcp-agents {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.899198 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: routers {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.901038 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: flavors {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.902309 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: service_profiles {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.903549 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: next_providers {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.905097 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: service_profiles {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.906607 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: floatingip-pools {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.907854 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: routers {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.909746 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: floatingips {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.910956 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: l3-routers {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.913009 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: l3-agents {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.914452 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: metering-labels {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.915848 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: metering-label-rules {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.917149 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: network-ip-availabilities {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.918563 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: bindings {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.920237 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: quotas {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.921728 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: quotas {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.923184 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: rbac-policies {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.924505 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: security-groups {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.925757 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: security-group-rules {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.927003 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: service-providers {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.928273 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: subnetpools {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.930860 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: subnetpools {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.932394 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: tags {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:52.934169 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: tags {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:53.052910 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: tags {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:53.054743 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: tags {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:53.056830 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: tags {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:53.058758 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: tags {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:53.060485 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: tags {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:53.062444 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: tags {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:53.064239 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: tags {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:53.066158 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron.api.extensions [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Extended resource: tags {{(pid=91656) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 31 16:11:53.072330 dv-cinder-793814-1-iscsi neutron-server[91656]: WARNING keystonemiddleware.auth_token [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True.
May 31 16:11:53.077036 dv-cinder-793814-1-iscsi neutron-server[91656]: WARNING keystonemiddleware.auth_token [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
May 31 16:11:53.085950 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_concurrency.lockutils [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Acquired lock "singleton_lock" {{(pid=91656) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}}
May 31 16:11:53.086425 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_concurrency.lockutils [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Releasing lock "singleton_lock" {{(pid=91656) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}}
May 31 16:11:53.087048 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO oslo_service.service [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Starting 2 workers
May 31 16:11:53.091795 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Started child 91763 {{(pid=91656) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 31 16:11:53.096289 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Started child 91764 {{(pid=91656) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 31 16:11:53.097075 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:11:53.097893 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO neutron.service [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Neutron service started, listening on 0.0.0.0:9696
May 31 16:11:53.098530 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Notify callbacks [] for process, before_spawn {{(pid=91656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:11:53.098684 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [-] (91763) wsgi starting up on http://0.0.0.0:9696
May 31 16:11:53.101454 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:11:53.102055 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO oslo_service.service [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Starting 1 workers
May 31 16:11:53.102780 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [-] (91764) wsgi starting up on http://0.0.0.0:9696
May 31 16:11:53.106859 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Started child 91765 {{(pid=91656) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 31 16:11:53.107359 dv-cinder-793814-1-iscsi neutron-server[91656]: INFO oslo_service.service [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Starting 1 workers
May 31 16:11:53.110348 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.service [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] calling RpcWorker wait() {{(pid=91765) _wait /opt/stack/neutron/neutron/service.py:128}}
May 31 16:11:53.110897 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.service [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] returning from RpcWorker wait() {{(pid=91765) _wait /opt/stack/neutron/neutron/service.py:135}}
May 31 16:11:53.111768 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Started child 91766 {{(pid=91656) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 31 16:11:53.112260 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:11:53.112561 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG neutron_lib.callbacks.manager [None req-d4eeaecd-619f-4901-8bd6-cbe7e7a7cf31 None None] Notify callbacks [] for process, after_spawn {{(pid=91656) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:11:53.112830 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:11:53.114426 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=91656) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
May 31 16:11:53.114643 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 31 16:11:53.114885 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 31 16:11:53.115098 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 31 16:11:53.115448 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 31 16:11:53.115609 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 31 16:11:53.116102 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.116381 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.116656 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.116907 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.117208 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.117337 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:11:53.117875 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.118041 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.118295 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.118576 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.118839 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.119013 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.119178 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.119421 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.119652 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.119959 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.120217 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.120483 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.120760 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.120930 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.121441 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.121735 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.121961 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.122241 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] debug                          = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.122479 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.122977 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.123214 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.123451 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.123695 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.123971 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.124194 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.124471 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.124707 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.124951 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.125163 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.125411 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.125678 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.125891 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.126109 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.126354 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.126587 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.127061 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] host                           = dv-cinder-793814-1-iscsi {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.127279 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.127493 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.127747 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.127990 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.128231 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.128447 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.128700 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.128939 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.129176 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.129402 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.129658 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.129906 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.130135 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.130921 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.131086 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.131309 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.131591 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.131854 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.132081 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.132325 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.132509 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.132762 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.132928 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.133176 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.133411 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.133646 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.133886 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.134093 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.134305 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.134578 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.134813 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.135065 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.135239 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.135485 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.135856 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.135994 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.136146 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.136368 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.136581 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.136797 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.137014 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.137254 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.137496 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.137729 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.137979 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.138204 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.138447 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.138682 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.138936 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.139179 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.139403 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.139621 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.139886 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.140115 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.140358 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.140613 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.140825 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.141065 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.141302 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.141505 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.141740 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.141945 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.142170 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.142412 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.142623 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.142966 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.143264 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.143429 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:11:53.143586 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.143728 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.144134 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.144405 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.144774 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.144948 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.145201 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.145436 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.145969 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.146736 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.146920 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.147150 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.147949 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.148661 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.148955 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.149213 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.149481 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.150911 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.150911 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.151181 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.151401 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.151661 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.151897 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.152138 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.152456 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.152716 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.152969 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.43/identity {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.153230 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.153445 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.153707 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.153939 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.154155 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.154366 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.154600 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.154874 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.155108 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.155321 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.155539 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.155756 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.156131 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.156244 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.156485 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.156722 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.156951 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.157182 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.157422 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.159985 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.160531 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.160926 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.161305 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.163614 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.163910 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.164257 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.164408 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.164636 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.164863 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.165101 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.165429 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.165656 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.165980 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.166487 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.166716 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.166949 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.167206 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.167429 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.167648 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.167884 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.168124 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.168356 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.168595 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.168836 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.169050 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.169266 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.169620 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.169894 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.170151 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.171297 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.171297 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.171297 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.171297 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.171297 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.176482 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.176739 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.176985 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.177315 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.177658 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.177880 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.178211 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.178470 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.178746 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.179010 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.179273 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.179504 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.179784 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.180036 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.180286 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.180510 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.180792 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.181062 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.181348 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.182076 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.183412 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.183761 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.184493 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.184707 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.184951 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.185217 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.187046 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.188762 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.189043 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.189305 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.189631 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.189925 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.190250 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.190520 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.190819 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.191050 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.191322 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.191631 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.191928 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.192193 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.192452 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.192696 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.195154 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.195428 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.195708 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.196197 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.196598 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.196881 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.197240 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.198330 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.198647 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.199157 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.199422 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.199917 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.200702 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.200945 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.205585 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.205585 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.205585 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.205585 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.205585 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.205585 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.205585 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.205585 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.206249 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.43/identity {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.206249 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.206249 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.206249 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.206249 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.206249 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.206249 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.206249 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.206828 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.206918 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.207424 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.207424 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.207667 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.207906 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.208128 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.208347 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.209177 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.209410 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.209849 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.210098 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.210318 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.210540 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.210769 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.210982 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.211234 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.211451 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.211731 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.211980 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.212282 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.212606 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.213092 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.213407 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.213706 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.213953 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.214189 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.214411 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.214636 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.214858 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.215647 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.215647 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.215647 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.216042 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.216330 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.216844 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.217375 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.217655 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.217881 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.218123 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.218336 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.219329 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.219579 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.219790 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.220004 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.220231 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.220430 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.220699 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.220944 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.221176 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.221392 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.221661 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.221890 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.222099 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.222325 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.222612 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.222856 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.223091 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.223336 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.223576 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.223799 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.224033 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.224812 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.225030 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.225239 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.225477 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.225731 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.225941 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.226150 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.226382 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.226610 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.226814 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.227040 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.227245 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.227449 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.227834 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.228044 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.228253 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.228465 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.228693 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.229013 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.229260 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.229498 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.229808 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.230035 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.230264 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.230529 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.230857 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.231069 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.231305 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.231521 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.231736 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.231953 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.232204 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.232514 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.232808 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.233072 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.233336 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.233628 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.233926 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:800:849'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.234186 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.234399 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.234715 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.235041 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.235311 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.235563 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.235813 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.236096 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.236335 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.236547 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.236768 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.237001 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.237211 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.237462 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.237719 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.237956 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.238166 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.238391 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.238604 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.238828 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.239055 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.239293 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.239522 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.239703 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 31 16:11:53.240830 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=91656) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
May 31 16:11:53.240998 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 31 16:11:53.241695 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 31 16:11:53.241695 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 31 16:11:53.241695 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 31 16:11:53.241944 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 31 16:11:53.242110 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.242211 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.242358 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.242525 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.243280 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.243465 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.243628 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.243828 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.244043 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.244272 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.244589 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.244733 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.245036 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.245036 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.245290 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.245416 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.245503 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.245897 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.245897 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.246323 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.246413 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.246504 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.246662 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] debug                          = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.246816 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.247143 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.247287 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.247446 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.247602 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.247758 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.247916 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.248071 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.248227 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.248386 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.248540 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.248677 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.248828 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.248982 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.249139 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.249293 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.249448 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.249630 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] host                           = dv-cinder-793814-1-iscsi {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.249786 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.249938 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.250244 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.250405 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.250558 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.250948 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.251109 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.251261 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.251411 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.251569 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.251722 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.252022 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.252168 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.252371 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.252539 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.252699 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.252857 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.253000 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.253177 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.253338 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.253495 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.253673 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.253829 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.253988 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.254142 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.254298 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.254454 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.254611 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.254765 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.254920 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.255075 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.255226 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.255956 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.256355 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.256514 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.256673 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.256836 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.256990 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.257145 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.257301 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.257457 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.257638 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.257794 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.257954 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.258110 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.258267 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.258438 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.258656 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.258820 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.258977 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.259135 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.259291 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.259456 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.259614 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.259769 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.259930 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.260083 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.260238 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.260393 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.260550 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.260707 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.260862 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.261017 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.261171 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.261326 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.261479 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.261656 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.261813 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.261976 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 31 16:11:53.262149 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.262303 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.262469 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.263240 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.263240 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.263240 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.263240 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.263240 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.263626 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.263785 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.263950 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.264099 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.264267 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.264424 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.264582 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.264742 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.264902 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.265061 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.265220 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.265378 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.265550 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.265713 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.265894 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.266557 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.266557 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.43/identity {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.266557 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.266557 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.266863 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.266863 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.267030 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.267109 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.267236 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.267393 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.268083 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.268083 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.268083 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.268083 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.268543 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.268543 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.268543 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.268860 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.268860 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.268860 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.269155 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.269155 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.269365 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.269480 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:11:53.269641 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.269641 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.269860 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.269954 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.270085 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.270248 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.270403 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.270561 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.270722 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.270881 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.271586 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.271754 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.271913 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.272072 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.272326 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.272513 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.272674 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.272819 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.272980 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.273131 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.273296 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.273440 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.273625 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.273786 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.273945 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.274103 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.274261 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.274415 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.274559 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.274721 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.274871 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.275031 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.275183 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.275336 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.275508 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.275660 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.275807 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.275949 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.276111 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.276284 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.276436 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.276594 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.276744 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.276904 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.277048 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.277208 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.277367 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.277552 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.277706 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.277843 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.278147 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.278456 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.278619 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.278778 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.278932 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.279090 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.279249 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.279406 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.279564 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.279721 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.279879 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.280037 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.280195 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.280352 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.280509 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.280678 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.280835 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.280996 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.281154 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.281318 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.281487 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.282800 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.282800 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.282800 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.282800 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.282800 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.283139 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.283207 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.283708 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.283708 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.284054 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.284226 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.284395 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.284661 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.284973 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.285157 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.285316 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.285666 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.285666 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.285842 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.285946 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.286115 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.286349 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.286455 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.286591 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.286875 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.287140 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.289824 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.43/identity {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.289954 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.290128 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.290309 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.290994 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 54836) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:11:53.291495 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.291686 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.291867 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.292046 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.292224 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.292397 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.292571 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.292741 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.292910 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.293080 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.293247 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.293414 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.293605 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.293773 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.293937 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.294103 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.294270 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.294434 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.294597 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.294751 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.294915 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.295079 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.295244 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.295409 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.295574 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.295762 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.295906 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.296069 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.296234 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.296400 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.296563 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.296728 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.296891 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.297054 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.297219 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.297382 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.297573 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.297739 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.297903 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.298067 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.298249 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.298413 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.298578 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.298749 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.298902 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.299064 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.299226 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.299389 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.299552 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.299772 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.299885 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.300107 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.300208 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.300341 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.300505 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.300670 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.300834 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.300998 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.301161 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.301377 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.301496 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.302121 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.302402 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.302578 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.302754 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.302919 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.303084 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.303249 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.303409 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.303582 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.303746 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.303909 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.304071 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.304234 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.304407 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.304570 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.304734 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.304896 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.305059 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.305230 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.305394 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.305610 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.305775 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.306014 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.306106 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [-] 10.222.0.43 "GET / HTTP/1.1" status: 200  len: 253 time: 0.0119863
May 31 16:11:53.306249 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.307080 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.307080 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.307080 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.307080 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.307397 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.307397 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.307540 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.307629 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.307785 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.307948 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.308951 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.309116 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.309283 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.309453 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.309899 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.309999 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.310299 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.310299 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.310469 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:800:849'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.311441 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.311615 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.311787 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.312039 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.312142 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.312285 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.312448 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.312611 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.312774 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.312937 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.313104 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.313265 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.313427 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.313615 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.314416 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.314416 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.314416 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.314416 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.314416 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.314804 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.314804 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.314948 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.315027 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 31 16:11:53.315202 dv-cinder-793814-1-iscsi neutron-server[91656]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 31 16:12:05.086459 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4679e33a-865d-4154-85c7-abe5d9fa2203 None None] get_active_networks_info from dv-cinder-793814-1-iscsi {{(pid=91765) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}}
May 31 16:12:05.162255 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4679e33a-865d-4154-85c7-abe5d9fa2203 None None] No non-hosted networks {{(pid=91765) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}}
May 31 16:12:05.170013 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.agentschedulers_db [None req-4679e33a-865d-4154-85c7-abe5d9fa2203 None None] DHCP Agent not found on host dv-cinder-793814-1-iscsi {{(pid=91765) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}}
May 31 16:12:05.294812 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-1cfd9b28-01ad-4b08-a171-3615d9d96143 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222'] for agent, after_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:07.855008 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222'] for agent, after_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:07.857049 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:07.857708 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:07.858309 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:07.859049 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:07.860636 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:07.861373 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:07.862055 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:07.864020 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:07.864976 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:07.865550 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:07.866742 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:07.867565 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:07.868616 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7f1427a615e0>, 'Open vSwitch agent', 'dv-cinder-793814-1-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:12:07.893066 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7f14279d2220>,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-793814-1-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:12:08.204555 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0c2c5cfb-4bca-4e9e-95b2-563dc7eb9c6c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222'] for agent, after_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:08.272557 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-5fb877ac-2872-42e9-b7b7-3d1e42c81885 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:09.149291 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222'] for agent, after_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:10.813659 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222'] for agent, after_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:12.525902 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 54932) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:12:13.259063 dv-cinder-793814-1-iscsi neutron-server[91764]: WARNING oslo_policy.policy [None req-cf93ae85-da6b-4cef-8aa2-6656c9bbc259 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 31 16:12:13.260018 dv-cinder-793814-1-iscsi neutron-server[91764]: WARNING oslo_policy.policy [None req-cf93ae85-da6b-4cef-8aa2-6656c9bbc259 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 31 16:12:13.605361 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [None req-cf93ae85-da6b-4cef-8aa2-6656c9bbc259 admin admin] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=91764) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 31 16:12:13.606535 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-cf93ae85-da6b-4cef-8aa2-6656c9bbc259 admin admin] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 1.0798202
May 31 16:12:14.617899 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.db.l3_hamode_db [None req-8796bcb6-47ea-46c3-a6f6-15cdc2acf4a0 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1
May 31 16:12:14.718642 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8796bcb6-47ea-46c3-a6f6-15cdc2acf4a0 None None] Routers set() bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:12:14.718952 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8796bcb6-47ea-46c3-a6f6-15cdc2acf4a0 None None] Router IDs set() for agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}}
May 31 16:12:16.221387 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 54946) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:12:16.666184 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-1edf2ff9-b35a-458c-bd54-5ac891137ec8 admin admin] Request body: {'subnetpool': {'shared': True, 'is_default': True, 'prefixes': ['172.20.0.0/16'], 'name': 'shared-default-subnetpool-v4', 'default_prefixlen': 26}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:12:16.778725 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.policy [None req-1edf2ff9-b35a-458c-bd54-5ac891137ec8 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=91764) register_rules /opt/stack/neutron/neutron/policy.py:73}}
May 31 16:12:16.829390 dv-cinder-793814-1-iscsi neutron-server[91764]: WARNING oslo_policy.policy [None req-1edf2ff9-b35a-458c-bd54-5ac891137ec8 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 31 16:12:16.829792 dv-cinder-793814-1-iscsi neutron-server[91764]: WARNING oslo_policy.policy [None req-1edf2ff9-b35a-458c-bd54-5ac891137ec8 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 31 16:12:16.840000 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.quota [None req-1edf2ff9-b35a-458c-bd54-5ac891137ec8 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7f142774ac40>.
May 31 16:12:16.857356 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-1edf2ff9-b35a-458c-bd54-5ac891137ec8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:12:16.931891 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-1edf2ff9-b35a-458c-bd54-5ac891137ec8 admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8732787540147', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8732787540508', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8732787561725', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8732787556777', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8732787514064', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8732787508022', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-526011', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-775737', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-16259627', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-16463760'] for rbac-policy, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:17.004019 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-1edf2ff9-b35a-458c-bd54-5ac891137ec8 admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:17.005891 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-1edf2ff9-b35a-458c-bd54-5ac891137ec8 admin admin] 10.222.0.43 "POST /v2.0/subnetpools HTTP/1.1" status: 201  len: 739 time: 0.7832963
May 31 16:12:19.889451 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 54960) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:12:20.281232 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Request body: {'network': {'tenant_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'name': 'private', 'project_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'admin_state_up': True}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:12:20.286954 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:12:20.291607 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Usage tracker for resource:network and tenant:84ea5f4a2e6548cd9fda529a1fcd3262 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:12:20.296211 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:12:20.302731 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:12:20.312467 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Made reservation on behalf of 84ea5f4a2e6548cd9fda529a1fcd3262 for: {'network': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:12:20.315503 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-639279'] for network, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:20.334549 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:20.348632 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:12:20.352512 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Usage tracker for resource:security_group_rule and tenant:84ea5f4a2e6548cd9fda529a1fcd3262 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:12:20.357901 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:12:20.363791 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:12:20.479926 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:20.484020 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:20.488334 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:12:20.519052 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 817}  {{(pid=91764) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 31 16:12:20.546785 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8732784586213', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:20.547417 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7f14285ede50> segment precommit_create {{(pid=91764) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
May 31 16:12:20.547896 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.db.segments_db [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Added segment d49e5363-96b9-4f81-bcb5-56040a583863 of type vlan for network e1a8e8fd-a72e-42dc-9b24-58627a309dc6
May 31 16:12:20.557271 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=467fd68d-8632-4823-9cd7-67f526ff7874,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:12:20.608910 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:20.609262 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:20.609654 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:20.610015 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:20.610345 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:20.610727 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:20.611040 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:20.611429 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:20.611774 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:20.612100 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:20.612413 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:20.612720 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Tracked resource versions report:
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]: pushed versions:
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]: {   'AddressGroup': {'1.2'},
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:     'ConntrackHelper': {'1.0'},
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:     'Log': {'1.0'},
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:     'Network': {'1.1'},
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:     'Port': {'1.7'},
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:     'PortForwarding': {'1.2'},
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:     'QosPolicy': {'1.8'},
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:     'SecurityGroup': {'1.4'},
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:     'SecurityGroupRule': {'1.2'},
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:     'SubPort': {'1.0'},
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:     'Subnet': {'1.1'},
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:     'Trunk': {'1.1'}}
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]: consumer versions:
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]: {   DHCP agent@dv-cinder-793814-1-iscsi: {},
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:     L3 agent@dv-cinder-793814-1-iscsi: {},
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:     Metadata agent@dv-cinder-793814-1-iscsi: {},
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:     Metering agent@dv-cinder-793814-1-iscsi: {},
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:     Open vSwitch agent@dv-cinder-793814-1-iscsi: {   'AddressGroup': '1.2',
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'ConntrackHelper': '1.0',
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'Log': '1.0',
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'Network': '1.1',
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'Port': '1.7',
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'PortForwarding': '1.2',
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'QosPolicy': '1.8',
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'SecurityGroup': '1.4',
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'SecurityGroupRule': '1.2',
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'SubPort': '1.0',
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'Subnet': '1.1',
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'Trunk': '1.1'}}
May 31 16:12:20.613879 dv-cinder-793814-1-iscsi neutron-server[91764]:  {{(pid=91764) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 31 16:12:20.665442 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:12:20.681980 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732784079930'] for network, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:20.726693 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366'] for network, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:20.728173 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:12:20.728808 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:20.734308 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:12:20.846367 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201  len: 849 time: 0.9557178
May 31 16:12:20.849895 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Pushing event updated for resources: {'Network': ['ID=e1a8e8fd-a72e-42dc-9b24-58627a309dc6,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:12:20.857625 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:12:20.866150 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Network e1a8e8fd-a72e-42dc-9b24-58627a309dc6 details requested by agent ovs-agent-dv-cinder-793814-1-iscsi with host dv-cinder-793814-1-iscsi {{(pid=91765) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 31 16:12:23.799394 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 54976) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:12:24.443579 dv-cinder-793814-1-iscsi neutron-server[91763]: WARNING oslo_policy.policy [None req-63bc7768-3444-479f-be1f-30dee324671b admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 31 16:12:24.444211 dv-cinder-793814-1-iscsi neutron-server[91763]: WARNING oslo_policy.policy [None req-63bc7768-3444-479f-be1f-30dee324671b admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 31 16:12:24.898460 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.policy [None req-63bc7768-3444-479f-be1f-30dee324671b admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=91763) register_rules /opt/stack/neutron/neutron/policy.py:73}}
May 31 16:12:24.945322 dv-cinder-793814-1-iscsi neutron-server[91763]: WARNING oslo_policy.policy [None req-63bc7768-3444-479f-be1f-30dee324671b admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 31 16:12:24.945737 dv-cinder-793814-1-iscsi neutron-server[91763]: WARNING oslo_policy.policy [None req-63bc7768-3444-479f-be1f-30dee324671b admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 31 16:12:24.954675 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63bc7768-3444-479f-be1f-30dee324671b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:12:24.956626 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-63bc7768-3444-479f-be1f-30dee324671b admin admin] 10.222.0.43 "GET /v2.0/networks/e1a8e8fd-a72e-42dc-9b24-58627a309dc6 HTTP/1.1" status: 200  len: 825 time: 1.1552241
May 31 16:12:24.991536 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-593c6ec9-84de-48c1-8e9c-bc470737ecc7 admin admin] 10.222.0.43 "GET /v2.0/subnetpools/17b185b4-2ec5-4329-8f25-dffe73dec126 HTTP/1.1" status: 200  len: 734 time: 0.0285640
May 31 16:12:25.002601 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Request body: {'subnet': {'name': 'private-subnet', 'subnetpool_id': '17b185b4-2ec5-4329-8f25-dffe73dec126', 'tenant_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'ip_version': 4, 'network_id': 'e1a8e8fd-a72e-42dc-9b24-58627a309dc6', 'gateway_ip': '172.20.0.1'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:12:25.004229 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.quota [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7f14276d8250>.
May 31 16:12:25.011519 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:12:25.017811 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Usage tracker for resource:subnet and tenant:84ea5f4a2e6548cd9fda529a1fcd3262 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:12:25.022222 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:12:25.029638 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:12:25.045811 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Made reservation on behalf of 84ea5f4a2e6548cd9fda529a1fcd3262 for: {'subnet': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:12:25.048788 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:25.603964 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357'] for subnet, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:25.608967 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:12:25.700153 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Checking segment: {'id': 'd49e5363-96b9-4f81-bcb5-56040a583863', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': 'e1a8e8fd-a72e-42dc-9b24-58627a309dc6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91763) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:12:25.700538 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Network hostable DHCP agents. Network: e1a8e8fd-a72e-42dc-9b24-58627a309dc6, hostable agents: ['5c9859e8-5965-4c86-8b2b-8fab235cbf66'], hosted agents: [] {{(pid=91763) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 31 16:12:25.706848 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a4e5f3d1-ea43-4e13-9ff1-6a292d95146d,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:12:25.720541 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:25.720929 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:25.721256 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:25.721582 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:25.721910 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:25.722262 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:25.722566 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:25.722881 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:25.723206 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:25.723581 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:25.723896 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:25.724241 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Tracked resource versions report:
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]: pushed versions:
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]: {   'AddressGroup': {'1.2'},
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:     'ConntrackHelper': {'1.0'},
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:     'Log': {'1.0'},
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:     'Network': {'1.1'},
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:     'Port': {'1.7'},
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:     'PortForwarding': {'1.2'},
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:     'QosPolicy': {'1.8'},
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:     'SecurityGroup': {'1.4'},
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:     'SecurityGroupRule': {'1.2'},
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:     'SubPort': {'1.0'},
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:     'Subnet': {'1.1'},
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:     'Trunk': {'1.1'}}
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]: consumer versions:
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]: {   DHCP agent@dv-cinder-793814-1-iscsi: {},
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:     L3 agent@dv-cinder-793814-1-iscsi: {},
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:     Metadata agent@dv-cinder-793814-1-iscsi: {},
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:     Metering agent@dv-cinder-793814-1-iscsi: {},
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:     Open vSwitch agent@dv-cinder-793814-1-iscsi: {   'AddressGroup': '1.2',
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'ConntrackHelper': '1.0',
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'Log': '1.0',
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'Network': '1.1',
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'Port': '1.7',
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'PortForwarding': '1.2',
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'QosPolicy': '1.8',
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'SecurityGroup': '1.4',
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'SecurityGroupRule': '1.2',
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'SubPort': '1.0',
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'Subnet': '1.1',
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'Trunk': '1.1'}}
May 31 16:12:25.725419 dv-cinder-793814-1-iscsi neutron-server[91763]:  {{(pid=91763) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 31 16:12:25.761008 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Network e1a8e8fd-a72e-42dc-9b24-58627a309dc6 is scheduled to be hosted by DHCP agent 5c9859e8-5965-4c86-8b2b-8fab235cbf66 with binding_index 1 {{(pid=91763) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 31 16:12:25.769147 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:12:25.775027 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793814-1-iscsi, e1a8e8fd-a72e-42dc-9b24-58627a309dc6) {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:12:25.780725 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:12:25.781391 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:25.786690 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-96520045-65f8-4335-bf92-63390db01041 None None] Network e1a8e8fd-a72e-42dc-9b24-58627a309dc6 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:12:25.811988 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 854 time: 0.8088481
May 31 16:12:26.158517 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp87ca72be-1027-56d4-a8d3-ba9dae998815-e1a8e8fd-a72e-42dc-9b24-58627a309dc6', 'network_id': 'e1a8e8fd-a72e-42dc-9b24-58627a309dc6', 'tenant_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'fixed_ips': [{'subnet_id': 'a4e5f3d1-ea43-4e13-9ff1-6a292d95146d'}]}} from dv-cinder-793814-1-iscsi. {{(pid=91765) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 31 16:12:26.159819 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:26.360739 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.db_base_plugin_common [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Allocated IP 172.20.0.2 (e1a8e8fd-a72e-42dc-9b24-58627a309dc6/a4e5f3d1-ea43-4e13-9ff1-6a292d95146d/3959291f-f70a-4e4e-aa0f-f98709aace03) {{(pid=91765) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:12:26.627963 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Notify callbacks [] for port, precommit_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:26.643435 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Transition to ACTIVE for port object 3959291f-f70a-4e4e-aa0f-f98709aace03 will not be triggered until provisioned by entity L2. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:12:26.666603 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Transition to ACTIVE for port object 3959291f-f70a-4e4e-aa0f-f98709aace03 will not be triggered until provisioned by entity DHCP. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:12:26.674412 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:26.680082 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:12:26.745160 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Network e1a8e8fd-a72e-42dc-9b24-58627a309dc6 is already hosted by enough agents. {{(pid=91765) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:12:26.748426 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.scheduler.base_scheduler [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Resources bound (agent type, host, resource id):  {{(pid=91765) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:12:26.756844 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Received port after_create {{(pid=91765) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:12:26.759211 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Pushing event updated for resources: {'Port': ['ID=3959291f-f70a-4e4e-aa0f-f98709aace03,revision_number=1']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:12:26.797917 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:26.798729 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:26.798729 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:26.798948 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:26.799353 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:26.799682 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:26.800010 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:26.800327 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:26.800730 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:26.801058 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:26.801375 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:26.802283 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Tracked resource versions report:
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]: pushed versions:
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]: {   'AddressGroup': {'1.2'},
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:     'ConntrackHelper': {'1.0'},
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:     'Log': {'1.0'},
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:     'Network': {'1.1'},
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:     'Port': {'1.7'},
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:     'PortForwarding': {'1.2'},
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:     'QosPolicy': {'1.8'},
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:     'SecurityGroup': {'1.4'},
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:     'SecurityGroupRule': {'1.2'},
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:     'SubPort': {'1.0'},
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:     'Subnet': {'1.1'},
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:     'Trunk': {'1.1'}}
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]: consumer versions:
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]: {   DHCP agent@dv-cinder-793814-1-iscsi: {},
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:     L3 agent@dv-cinder-793814-1-iscsi: {},
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:     Metadata agent@dv-cinder-793814-1-iscsi: {},
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:     Metering agent@dv-cinder-793814-1-iscsi: {},
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:     Open vSwitch agent@dv-cinder-793814-1-iscsi: {   'AddressGroup': '1.2',
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'ConntrackHelper': '1.0',
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'Log': '1.0',
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'Network': '1.1',
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'Port': '1.7',
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'PortForwarding': '1.2',
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'QosPolicy': '1.8',
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'SecurityGroup': '1.4',
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'SecurityGroupRule': '1.2',
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'SubPort': '1.0',
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'Subnet': '1.1',
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'Trunk': '1.1'}}
May 31 16:12:26.803463 dv-cinder-793814-1-iscsi neutron-server[91765]:  {{(pid=91765) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 31 16:12:26.812003 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:12:26.869877 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Attempting to bind port 3959291f-f70a-4e4e-aa0f-f98709aace03 on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:12:26.870285 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Attempting to bind port 3959291f-f70a-4e4e-aa0f-f98709aace03 by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': 'd49e5363-96b9-4f81-bcb5-56040a583863', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': 'e1a8e8fd-a72e-42dc-9b24-58627a309dc6'}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:12:26.870715 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Attempting to bind port 3959291f-f70a-4e4e-aa0f-f98709aace03 on network e1a8e8fd-a72e-42dc-9b24-58627a309dc6 {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:12:26.876667 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 12, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:12:26.877084 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Checking segment: {'id': 'd49e5363-96b9-4f81-bcb5-56040a583863', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': 'e1a8e8fd-a72e-42dc-9b24-58627a309dc6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91765) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:12:26.877569 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:26.878022 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Bound using segment: {'id': 'd49e5363-96b9-4f81-bcb5-56040a583863', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': 'e1a8e8fd-a72e-42dc-9b24-58627a309dc6'} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:12:26.878485 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Bound port: 3959291f-f70a-4e4e-aa0f-f98709aace03, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd49e5363-96b9-4f81-bcb5-56040a583863', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': 'e1a8e8fd-a72e-42dc-9b24-58627a309dc6'}}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:12:26.878861 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:26.976400 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] For port 3959291f-f70a-4e4e-aa0f-f98709aace03, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91765) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:12:26.982813 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] For port 3959291f-f70a-4e4e-aa0f-f98709aace03, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=3959291f-f70a-4e4e-aa0f-f98709aace03,segment=NetworkSegment(d49e5363-96b9-4f81-bcb5-56040a583863),segment_id=d49e5363-96b9-4f81-bcb5-56040a583863)] {{(pid=91765) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:12:26.987876 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:26.993426 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:12:27.083158 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Pushing event updated for resources: {'Port': ['ID=3959291f-f70a-4e4e-aa0f-f98709aace03,revision_number=2']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:12:27.086887 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:12:28.444593 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 54996) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:12:28.847381 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [None req-92481e59-2ff7-44f3-8fa4-0429de2a7687 admin admin] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=91764) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 31 16:12:28.848977 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-92481e59-2ff7-44f3-8fa4-0429de2a7687 admin admin] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.4027801
May 31 16:12:31.238601 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 55006) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:12:31.645968 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [None req-06e740f5-4283-400a-9c0a-ec318f4750bc admin admin] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=91764) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 31 16:12:31.646961 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-06e740f5-4283-400a-9c0a-ec318f4750bc admin admin] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.4073758
May 31 16:12:32.208892 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 3959291f-f70a-4e4e-aa0f-f98709aace03 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:12:32.291944 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port 3959291f-f70a-4e4e-aa0f-f98709aace03 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:12:32.743156 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3bdb7f4d-685f-45f6-a274-5e0d0e751e2e None None] Network e1a8e8fd-a72e-42dc-9b24-58627a309dc6 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:12:32.881116 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-fabd3325-c7f2-4db0-8162-7902e540c211 None None] Provisioning for port 3959291f-f70a-4e4e-aa0f-f98709aace03 completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:12:32.891414 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-fabd3325-c7f2-4db0-8162-7902e540c211 None None] Provisioning complete for port 3959291f-f70a-4e4e-aa0f-f98709aace03 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:12:32.891812 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-fabd3325-c7f2-4db0-8162-7902e540c211 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:33.116594 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-fabd3325-c7f2-4db0-8162-7902e540c211 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:33.158529 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-fabd3325-c7f2-4db0-8162-7902e540c211 None None] For port 3959291f-f70a-4e4e-aa0f-f98709aace03, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=3959291f-f70a-4e4e-aa0f-f98709aace03,segment=NetworkSegment(d49e5363-96b9-4f81-bcb5-56040a583863),segment_id=d49e5363-96b9-4f81-bcb5-56040a583863)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:12:33.164008 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-fabd3325-c7f2-4db0-8162-7902e540c211 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:33.170624 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:12:33.249657 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fabd3325-c7f2-4db0-8162-7902e540c211 None None] Pushing event updated for resources: {'Port': ['ID=3959291f-f70a-4e4e-aa0f-f98709aace03,revision_number=3']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:12:33.254728 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-fabd3325-c7f2-4db0-8162-7902e540c211 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:12:33.386898 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-c63246b4-2721-4468-977d-ae5b2b133d8e None None] Provisioning complete for port 3959291f-f70a-4e4e-aa0f-f98709aace03 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:12:33.387305 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-c63246b4-2721-4468-977d-ae5b2b133d8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:34.169100 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 5 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:12:34.183876 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 3959291f-f70a-4e4e-aa0f-f98709aace03 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:12:34.254207 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 3959291f-f70a-4e4e-aa0f-f98709aace03 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:12:34.255474 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:34.357488 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 55022) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:12:34.719790 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-e130ff47-55be-4c51-8c3b-651cadda3c48 admin admin] Request body: {'router': {'admin_state_up': True, 'tenant_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'name': 'router1'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:12:34.724929 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-e130ff47-55be-4c51-8c3b-651cadda3c48 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:12:34.728713 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-e130ff47-55be-4c51-8c3b-651cadda3c48 admin admin] Usage tracker for resource:router and tenant:84ea5f4a2e6548cd9fda529a1fcd3262 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:12:34.732038 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-e130ff47-55be-4c51-8c3b-651cadda3c48 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:12:34.737709 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-e130ff47-55be-4c51-8c3b-651cadda3c48 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:12:34.748832 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e130ff47-55be-4c51-8c3b-651cadda3c48 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-16623804', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-697'] for router, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:34.750461 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e130ff47-55be-4c51-8c3b-651cadda3c48 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-16618684', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-16621667', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-16430734', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-672'] for router, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:34.772802 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e130ff47-55be-4c51-8c3b-651cadda3c48 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:34.882817 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e130ff47-55be-4c51-8c3b-651cadda3c48 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-16623797', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16621573'] for router, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:34.901200 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e130ff47-55be-4c51-8c3b-651cadda3c48 admin admin] Notify callbacks [] for router, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:34.902414 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-e130ff47-55be-4c51-8c3b-651cadda3c48 admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201  len: 709 time: 0.5439448
May 31 16:12:34.960614 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-99dbdf04-fd9b-4ee3-91fc-3fb4f0f9d314 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:37.295187 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 55032) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:12:37.683630 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [None req-17678683-36ea-413f-a6c2-903cd6de5e5f admin admin] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=91764) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 31 16:12:37.684604 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-17678683-36ea-413f-a6c2-903cd6de5e5f admin admin] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3884552
May 31 16:12:37.852831 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:38.197176 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f51714d7-287a-4f5b-a942-918261cd9af6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:39.075067 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:40.137045 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 55052) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:12:40.300208 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Request body: {'network': {'admin_state_up': True, 'provider:network_type': 'flat', 'provider:physical_network': 'physnet1', 'router:external': True, 'name': 'public', 'is_default': True}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:12:40.306691 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:12:40.310733 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Usage tracker for resource:network and tenant:62d3939038d943a283e167c51790b574 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:12:40.313574 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:12:40.319252 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:12:40.329360 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Made reservation on behalf of 62d3939038d943a283e167c51790b574 for: {'network': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:12:40.331761 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-639279'] for network, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:40.345016 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:40.360013 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:12:40.363696 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Usage tracker for resource:security_group_rule and tenant:62d3939038d943a283e167c51790b574 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:12:40.367352 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:12:40.373287 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:12:40.460657 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:40.464214 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:40.468212 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:12:40.482740 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Reserving flat network on physical network physnet1 {{(pid=91764) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}}
May 31 16:12:40.506635 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cdd1f90a-b437-4456-8973-cf26d48e85c9,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:12:40.509329 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:40.509694 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.db.segments_db [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Added segment 2373ca36-2a20-452a-927f-d77f06588c5e of type flat for network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c
May 31 16:12:40.510840 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:12:40.543660 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732784079930'] for network, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:40.581159 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366'] for network, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:40.583617 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:12:40.584285 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:40.587845 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:12:40.713667 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.5753105
May 31 16:12:40.714472 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Pushing event updated for resources: {'Network': ['ID=00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:12:40.717459 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:12:40.727435 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c details requested by agent ovs-agent-dv-cinder-793814-1-iscsi with host dv-cinder-793814-1-iscsi {{(pid=91765) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 31 16:12:40.839332 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:42.975763 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 55072) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:12:43.111068 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa783f0a-70c8-4ce7-bedd-fbfdc714bbe9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:12:43.112395 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-aa783f0a-70c8-4ce7-bedd-fbfdc714bbe9 admin admin] 10.222.0.43 "GET /v2.0/subnets/a4e5f3d1-ea43-4e13-9ff1-6a292d95146d HTTP/1.1" status: 200  len: 849 time: 0.1357484
May 31 16:12:43.317640 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-d96b1403-fe9a-4eaf-ac4d-77469122ddb5 admin admin] 10.222.0.43 "GET /v2.0/routers/91972da3-5db4-4114-848c-2ac4ccf9c8bd HTTP/1.1" status: 200  len: 704 time: 0.1990438
May 31 16:12:43.811929 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:44.102859 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Allocated IP 172.20.0.1 (e1a8e8fd-a72e-42dc-9b24-58627a309dc6/a4e5f3d1-ea43-4e13-9ff1-6a292d95146d/bd5e0a1e-5240-480a-a613-3bb2d871d5e4) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:12:44.286295 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:44.305129 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.provisioning_blocks [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Transition to ACTIVE for port object bd5e0a1e-5240-480a-a613-3bb2d871d5e4 will not be triggered until provisioned by entity DHCP. {{(pid=91763) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:12:44.368120 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:44.373632 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:12:44.447495 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Network e1a8e8fd-a72e-42dc-9b24-58627a309dc6 is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:12:44.450367 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:12:44.454614 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:12:44.455179 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-16627828'] for router_interface, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:44.594139 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Pushing event updated for resources: {'Port': ['ID=bd5e0a1e-5240-480a-a613-3bb2d871d5e4,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:12:44.611459 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.238s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:12:44.699397 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-31b1408a-a0f3-46a1-8274-a174e55ed72c None None] Provisioning for port bd5e0a1e-5240-480a-a613-3bb2d871d5e4 completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:12:44.704854 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-31b1408a-a0f3-46a1-8274-a174e55ed72c None None] Provisioning complete for port bd5e0a1e-5240-480a-a613-3bb2d871d5e4 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:12:44.705490 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-31b1408a-a0f3-46a1-8274-a174e55ed72c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:44.769499 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-31b1408a-a0f3-46a1-8274-a174e55ed72c None None] Port bd5e0a1e-5240-480a-a613-3bb2d871d5e4 cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:12:44.800077 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:45.059590 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:45.064129 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:45.065320 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-16310860', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-16627929'] for router_interface, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:45.069362 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:12:45.207123 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Pushing event updated for resources: {'Port': ['ID=bd5e0a1e-5240-480a-a613-3bb2d871d5e4,revision_number=2']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:12:45.212096 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:12:45.282498 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Network e1a8e8fd-a72e-42dc-9b24-58627a309dc6 is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:12:45.283575 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:12:45.497625 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-d98450ac-df75-4bc6-b64a-91aec526106c None None] Provisioning complete for port bd5e0a1e-5240-480a-a613-3bb2d871d5e4 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:12:45.498131 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-d98450ac-df75-4bc6-b64a-91aec526106c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:45.512999 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Router 91972da3-5db4-4114-848c-2ac4ccf9c8bd is scheduled to L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e with binding_index 1 {{(pid=91763) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 31 16:12:45.555254 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-d98450ac-df75-4bc6-b64a-91aec526106c None None] Port bd5e0a1e-5240-480a-a613-3bb2d871d5e4 cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:12:45.698877 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:12:45.709226 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] Sync routers for ids ['91972da3-5db4-4114-848c-2ac4ccf9c8bd'] in dv-cinder-793814-1-iscsi {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:12:45.711138 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] 10.222.0.43 "PUT /v2.0/routers/91972da3-5db4-4114-848c-2ac4ccf9c8bd/add_router_interface HTTP/1.1" status: 200  len: 508 time: 2.3876488
May 31 16:12:45.725779 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] Routers {'91972da3-5db4-4114-848c-2ac4ccf9c8bd'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:12:45.727677 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1427a234f0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:12:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['91972da3-5db4-4114-848c-2ac4ccf9c8bd'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:12:45.943206 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] Set router 91972da3-5db4-4114-848c-2ac4ccf9c8bd gateway port host: None {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:12:46.404358 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1427a234f0>, [{'id': '91972da3-5db4-4114-848c-2ac4ccf9c8bd', 'name': 'router1', 'tenant_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:12:34Z', 'updated_at': '2021-05-31T16:12:44Z', 'revision_number': 2, 'project_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'gw_port_host': None, '_interfaces': [{'id': 'bd5e0a1e-5240-480a-a613-3bb2d871d5e4', 'name': '', 'network_id': 'e1a8e8fd-a72e-42dc-9b24-58627a309dc6', 'tenant_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'mac_address': 'fa:16:3e:44:2c:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91972da3-5db4-4114-848c-2ac4ccf9c8bd', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'a4e5f3d1-ea43-4e13-9ff1-6a292d95146d', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:12:43Z', 'updated_at': '2021-05-31T16:12:44Z', 'revision_number': 2, 'project_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'subnets': [{'id': 'a4e5f3d1-ea43-4e13-9ff1-6a292d95146d', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '17b185b4-2ec5-4329-8f25-dffe73dec126'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:12:46.413689 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] Checking router: 91972da3-5db4-4114-848c-2ac4ccf9c8bd for host: dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:12:46.413689 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] Updating router 91972da3-5db4-4114-848c-2ac4ccf9c8bd port bd5e0a1e-5240-480a-a613-3bb2d871d5e4 binding host dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 31 16:12:46.477890 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:46.919207 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] Notify callbacks [] for port, precommit_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:46.936025 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.provisioning_blocks [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] Transition to ACTIVE for port object bd5e0a1e-5240-480a-a613-3bb2d871d5e4 will not be triggered until provisioned by entity L2. {{(pid=91766) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:12:46.944306 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:46.949852 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:12:47.176115 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d2a23bd-8f28-4a4d-a143-3c2bfe4162ea None None] Pushing event updated for resources: {'Port': ['ID=bd5e0a1e-5240-480a-a613-3bb2d871d5e4,revision_number=3']} {{(pid=91766) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:12:47.225457 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2a23bd-8f28-4a4d-a143-3c2bfe4162ea None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:47.225816 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2a23bd-8f28-4a4d-a143-3c2bfe4162ea None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:47.226181 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2a23bd-8f28-4a4d-a143-3c2bfe4162ea None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:47.226646 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2a23bd-8f28-4a4d-a143-3c2bfe4162ea None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:47.227049 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2a23bd-8f28-4a4d-a143-3c2bfe4162ea None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:47.227396 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2a23bd-8f28-4a4d-a143-3c2bfe4162ea None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:47.227819 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2a23bd-8f28-4a4d-a143-3c2bfe4162ea None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:47.228155 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2a23bd-8f28-4a4d-a143-3c2bfe4162ea None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:47.228654 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2a23bd-8f28-4a4d-a143-3c2bfe4162ea None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:47.228938 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2a23bd-8f28-4a4d-a143-3c2bfe4162ea None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:47.229378 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2a23bd-8f28-4a4d-a143-3c2bfe4162ea None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:47.229815 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2a23bd-8f28-4a4d-a143-3c2bfe4162ea None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2a23bd-8f28-4a4d-a143-3c2bfe4162ea None None] Tracked resource versions report:
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]: pushed versions:
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]: {   'AddressGroup': {'1.2'},
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:     'ConntrackHelper': {'1.0'},
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:     'Log': {'1.0'},
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:     'Network': {'1.1'},
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:     'Port': {'1.7'},
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:     'PortForwarding': {'1.2'},
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:     'QosPolicy': {'1.8'},
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:     'SecurityGroup': {'1.4'},
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:     'SecurityGroupRule': {'1.2'},
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:     'SubPort': {'1.0'},
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:     'Subnet': {'1.1'},
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:     'Trunk': {'1.1'}}
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]: consumer versions:
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]: {   DHCP agent@dv-cinder-793814-1-iscsi: {},
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:     L3 agent@dv-cinder-793814-1-iscsi: {},
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:     Metadata agent@dv-cinder-793814-1-iscsi: {},
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:     Metering agent@dv-cinder-793814-1-iscsi: {},
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:     Open vSwitch agent@dv-cinder-793814-1-iscsi: {   'AddressGroup': '1.2',
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'ConntrackHelper': '1.0',
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'Log': '1.0',
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'Network': '1.1',
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'Port': '1.7',
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'PortForwarding': '1.2',
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'QosPolicy': '1.8',
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'SecurityGroup': '1.4',
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'SecurityGroupRule': '1.2',
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'SubPort': '1.0',
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'Subnet': '1.1',
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'Trunk': '1.1'}}
May 31 16:12:47.231143 dv-cinder-793814-1-iscsi neutron-server[91766]:  {{(pid=91766) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 31 16:12:47.245912 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-4d2a23bd-8f28-4a4d-a143-3c2bfe4162ea None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.296s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:12:47.256552 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] Attempting to bind port bd5e0a1e-5240-480a-a613-3bb2d871d5e4 on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:12:47.257207 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] Attempting to bind port bd5e0a1e-5240-480a-a613-3bb2d871d5e4 by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': 'd49e5363-96b9-4f81-bcb5-56040a583863', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': 'e1a8e8fd-a72e-42dc-9b24-58627a309dc6'}] {{(pid=91766) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:12:47.257889 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] Attempting to bind port bd5e0a1e-5240-480a-a613-3bb2d871d5e4 on network e1a8e8fd-a72e-42dc-9b24-58627a309dc6 {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:12:47.268032 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 12, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:12:47.268572 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] Checking segment: {'id': 'd49e5363-96b9-4f81-bcb5-56040a583863', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': 'e1a8e8fd-a72e-42dc-9b24-58627a309dc6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91766) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:12:47.269322 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:47.270601 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] Bound using segment: {'id': 'd49e5363-96b9-4f81-bcb5-56040a583863', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': 'e1a8e8fd-a72e-42dc-9b24-58627a309dc6'} {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:12:47.271355 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] Bound port: bd5e0a1e-5240-480a-a613-3bb2d871d5e4, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd49e5363-96b9-4f81-bcb5-56040a583863', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': 'e1a8e8fd-a72e-42dc-9b24-58627a309dc6'}}] {{(pid=91766) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:12:47.271965 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:47.413021 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.db [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] For port bd5e0a1e-5240-480a-a613-3bb2d871d5e4, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91766) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:12:47.418686 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.db [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] For port bd5e0a1e-5240-480a-a613-3bb2d871d5e4, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=bd5e0a1e-5240-480a-a613-3bb2d871d5e4,segment=NetworkSegment(d49e5363-96b9-4f81-bcb5-56040a583863),segment_id=d49e5363-96b9-4f81-bcb5-56040a583863)] {{(pid=91766) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:12:47.425306 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:47.432201 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-4d2a23bd-8f28-4a4d-a143-3c2bfe4162ea None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:12:47.557694 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d2a23bd-8f28-4a4d-a143-3c2bfe4162ea None None] Pushing event updated for resources: {'Port': ['ID=bd5e0a1e-5240-480a-a613-3bb2d871d5e4,revision_number=4']} {{(pid=91766) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:12:47.561541 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] Routers {'91972da3-5db4-4114-848c-2ac4ccf9c8bd'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:12:47.562164 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1427a234f0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:12:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['91972da3-5db4-4114-848c-2ac4ccf9c8bd'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:12:47.619385 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-4d2a23bd-8f28-4a4d-a143-3c2bfe4162ea None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:12:47.759413 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] Set router 91972da3-5db4-4114-848c-2ac4ccf9c8bd gateway port host: None {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:12:48.106303 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 55084) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:12:48.159714 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1427a234f0>, [{'id': '91972da3-5db4-4114-848c-2ac4ccf9c8bd', 'name': 'router1', 'tenant_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:12:34Z', 'updated_at': '2021-05-31T16:12:44Z', 'revision_number': 2, 'project_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'gw_port_host': None, '_interfaces': [{'id': 'bd5e0a1e-5240-480a-a613-3bb2d871d5e4', 'name': '', 'network_id': 'e1a8e8fd-a72e-42dc-9b24-58627a309dc6', 'tenant_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'mac_address': 'fa:16:3e:44:2c:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91972da3-5db4-4114-848c-2ac4ccf9c8bd', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'a4e5f3d1-ea43-4e13-9ff1-6a292d95146d', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:12:43Z', 'updated_at': '2021-05-31T16:12:47Z', 'revision_number': 4, 'project_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'subnets': [{'id': 'a4e5f3d1-ea43-4e13-9ff1-6a292d95146d', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '17b185b4-2ec5-4329-8f25-dffe73dec126'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:12:48.165003 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65badc56-ff4f-4f52-adfa-4a2634c40805 None None] The sync data for ids ['91972da3-5db4-4114-848c-2ac4ccf9c8bd'] in dv-cinder-793814-1-iscsi is: [{'id': '91972da3-5db4-4114-848c-2ac4ccf9c8bd', 'name': 'router1', 'tenant_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:12:34Z', 'updated_at': '2021-05-31T16:12:44Z', 'revision_number': 2, 'project_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'gw_port_host': None, '_interfaces': [{'id': 'bd5e0a1e-5240-480a-a613-3bb2d871d5e4', 'name': '', 'network_id': 'e1a8e8fd-a72e-42dc-9b24-58627a309dc6', 'tenant_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'mac_address': 'fa:16:3e:44:2c:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91972da3-5db4-4114-848c-2ac4ccf9c8bd', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'a4e5f3d1-ea43-4e13-9ff1-6a292d95146d', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:12:43Z', 'updated_at': '2021-05-31T16:12:47Z', 'revision_number': 4, 'project_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'subnets': [{'id': 'a4e5f3d1-ea43-4e13-9ff1-6a292d95146d', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '17b185b4-2ec5-4329-8f25-dffe73dec126'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:12:48.308565 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c515e3c7-8423-426c-be19-4a00c2532ba7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:12:48.309290 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-c515e3c7-8423-426c-be19-4a00c2532ba7 admin admin] Synchronizing usage tracker for tenant:62d3939038d943a283e167c51790b574 on resource:network {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:12:48.336034 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-c515e3c7-8423-426c-be19-4a00c2532ba7 admin admin] Unset dirty status for tenant:62d3939038d943a283e167c51790b574 on resource:network {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:12:48.337968 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-c515e3c7-8423-426c-be19-4a00c2532ba7 admin admin] 10.222.0.43 "GET /v2.0/networks/00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c HTTP/1.1" status: 200  len: 842 time: 0.2304966
May 31 16:12:48.350252 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-b2f21540-d749-4825-af7b-be7dcd799bfb admin admin] Request body: {'subnet': {'enable_dhcp': False, 'gateway_ip': '172.27.0.1', 'cidr': '172.27.0.0/24', 'name': 'public-subnet', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'ip_version': 4}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:12:48.357932 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-b2f21540-d749-4825-af7b-be7dcd799bfb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:12:48.364785 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-b2f21540-d749-4825-af7b-be7dcd799bfb admin admin] Usage tracker for resource:subnet and tenant:62d3939038d943a283e167c51790b574 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:12:48.370782 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-b2f21540-d749-4825-af7b-be7dcd799bfb admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:12:48.377990 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-b2f21540-d749-4825-af7b-be7dcd799bfb admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:12:48.389876 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b2f21540-d749-4825-af7b-be7dcd799bfb admin admin] Made reservation on behalf of 62d3939038d943a283e167c51790b574 for: {'subnet': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:12:48.392739 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b2f21540-d749-4825-af7b-be7dcd799bfb admin admin] Notify callbacks [] for subnet, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:48.900331 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.objects.ports [None req-b2f21540-d749-4825-af7b-be7dcd799bfb admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=91764) get_objects /opt/stack/neutron/neutron/objects/ports.py:443}}
May 31 16:12:48.900834 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b2f21540-d749-4825-af7b-be7dcd799bfb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357'] for subnet, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:48.905926 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:12:48.989466 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2f21540-d749-4825-af7b-be7dcd799bfb admin admin] Pushing event updated for resources: {'Subnet': ['ID=96709d85-d0fe-4cf8-b232-eaf6b143ebe6,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:12:48.999729 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-b2f21540-d749-4825-af7b-be7dcd799bfb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:12:49.004505 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2f21540-d749-4825-af7b-be7dcd799bfb admin admin] Checking segment: {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:12:49.004972 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2f21540-d749-4825-af7b-be7dcd799bfb admin admin] Network hostable DHCP agents. Network: 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c, hostable agents: ['5c9859e8-5965-4c86-8b2b-8fab235cbf66'], hosted agents: [] {{(pid=91764) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 31 16:12:49.027067 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2f21540-d749-4825-af7b-be7dcd799bfb admin admin] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c is scheduled to be hosted by DHCP agent 5c9859e8-5965-4c86-8b2b-8fab235cbf66 with binding_index 1 {{(pid=91764) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 31 16:12:49.038771 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-b2f21540-d749-4825-af7b-be7dcd799bfb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793814-1-iscsi, 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c) {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:12:49.043630 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2f21540-d749-4825-af7b-be7dcd799bfb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:12:49.044260 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b2f21540-d749-4825-af7b-be7dcd799bfb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:49.058477 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7ce857ec-edde-4af0-9655-26acbc20a263 None None] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:12:49.074823 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-b2f21540-d749-4825-af7b-be7dcd799bfb admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 821 time: 0.7295628
May 31 16:12:49.360375 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c676623-1f46-4662-b0e6-5a6f4832727c None None] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:12:51.565879 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 55098) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:12:51.800626 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-c36099b6-5358-4f0e-bd9b-2ca2aa4639c2 admin admin] 10.222.0.43 "GET /v2.0/routers/91972da3-5db4-4114-848c-2ac4ccf9c8bd HTTP/1.1" status: 200  len: 710 time: 0.2336106
May 31 16:12:51.939733 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-04f603bf-b2d2-4c7e-b500-2b77be59bf82 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:12:51.941068 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-04f603bf-b2d2-4c7e-b500-2b77be59bf82 admin admin] 10.222.0.43 "GET /v2.0/networks/00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c HTTP/1.1" status: 200  len: 886 time: 0.1352525
May 31 16:12:51.951100 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-d03212b1-daab-43c7-81a1-e21dd7ca1580 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:12:52.221482 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device bd5e0a1e-5240-480a-a613-3bb2d871d5e4 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:12:52.309062 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port bd5e0a1e-5240-480a-a613-3bb2d871d5e4 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:12:52.319123 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port bd5e0a1e-5240-480a-a613-3bb2d871d5e4 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:12:52.319415 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:52.455142 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:52.496361 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port bd5e0a1e-5240-480a-a613-3bb2d871d5e4, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=bd5e0a1e-5240-480a-a613-3bb2d871d5e4,segment=NetworkSegment(d49e5363-96b9-4f81-bcb5-56040a583863),segment_id=d49e5363-96b9-4f81-bcb5-56040a583863)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:12:52.502941 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:52.509988 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-c59e3f72-f1ff-4baa-b61e-efad8e0ebd4d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:12:52.526136 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-d03212b1-daab-43c7-81a1-e21dd7ca1580 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16621638', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16623758', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-722'] for router, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:52.611743 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=bd5e0a1e-5240-480a-a613-3bb2d871d5e4,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:12:52.615305 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:12:52.922477 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-d03212b1-daab-43c7-81a1-e21dd7ca1580 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:52.980945 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-d03212b1-daab-43c7-81a1-e21dd7ca1580 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:53.142321 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [None req-d03212b1-daab-43c7-81a1-e21dd7ca1580 admin admin] Allocated IP 172.27.0.16 (00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c/96709d85-d0fe-4cf8-b232-eaf6b143ebe6/f849b98d-c136-425a-a8fe-c7596ff6c309) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:12:53.319513 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-d03212b1-daab-43c7-81a1-e21dd7ca1580 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:53.377555 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-d03212b1-daab-43c7-81a1-e21dd7ca1580 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:53.382294 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:12:53.448082 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d03212b1-daab-43c7-81a1-e21dd7ca1580 admin admin] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:12:53.451370 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-d03212b1-daab-43c7-81a1-e21dd7ca1580 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:12:53.455994 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d03212b1-daab-43c7-81a1-e21dd7ca1580 admin admin] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:12:53.525950 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d03212b1-daab-43c7-81a1-e21dd7ca1580 admin admin] Pushing event updated for resources: {'Port': ['ID=f849b98d-c136-425a-a8fe-c7596ff6c309,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:12:53.582334 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-d03212b1-daab-43c7-81a1-e21dd7ca1580 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.200s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:12:53.882968 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-d03212b1-daab-43c7-81a1-e21dd7ca1580 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:54.198180 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device bd5e0a1e-5240-480a-a613-3bb2d871d5e4 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:12:54.277015 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port bd5e0a1e-5240-480a-a613-3bb2d871d5e4 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:12:54.277510 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:54.287967 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-d03212b1-daab-43c7-81a1-e21dd7ca1580 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16621638', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16623758', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-722'] for router, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:54.291496 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-d03212b1-daab-43c7-81a1-e21dd7ca1580 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16621573', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-16621645', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-16621580', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-16623768'] for router, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:54.474124 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d03212b1-daab-43c7-81a1-e21dd7ca1580 admin admin] Router 91972da3-5db4-4114-848c-2ac4ccf9c8bd has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91764) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:12:54.652030 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d03212b1-daab-43c7-81a1-e21dd7ca1580 admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91764) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:12:54.660033 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-d03212b1-daab-43c7-81a1-e21dd7ca1580 admin admin] Notify callbacks [] for router, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:54.661660 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-d03212b1-daab-43c7-81a1-e21dd7ca1580 admin admin] 10.222.0.43 "PUT /v2.0/routers/91972da3-5db4-4114-848c-2ac4ccf9c8bd HTTP/1.1" status: 200  len: 889 time: 2.7140861
May 31 16:12:54.661992 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] Sync routers for ids ['91972da3-5db4-4114-848c-2ac4ccf9c8bd'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:12:54.672013 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] Routers {'91972da3-5db4-4114-848c-2ac4ccf9c8bd'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:12:54.672685 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f142aac8ee0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:12:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['91972da3-5db4-4114-848c-2ac4ccf9c8bd'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:12:54.865604 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] Set router 91972da3-5db4-4114-848c-2ac4ccf9c8bd gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:12:55.214240 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f142aac8ee0>, [{'id': '91972da3-5db4-4114-848c-2ac4ccf9c8bd', 'name': 'router1', 'tenant_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.16'}], 'enable_snat': True}, 'gw_port_id': 'f849b98d-c136-425a-a8fe-c7596ff6c309', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:12:34Z', 'updated_at': '2021-05-31T16:12:53Z', 'revision_number': 4, 'project_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'gw_port': {'id': 'f849b98d-c136-425a-a8fe-c7596ff6c309', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:96:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91972da3-5db4-4114-848c-2ac4ccf9c8bd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:12:53Z', 'updated_at': '2021-05-31T16:12:53Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': 'bd5e0a1e-5240-480a-a613-3bb2d871d5e4', 'name': '', 'network_id': 'e1a8e8fd-a72e-42dc-9b24-58627a309dc6', 'tenant_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'mac_address': 'fa:16:3e:44:2c:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91972da3-5db4-4114-848c-2ac4ccf9c8bd', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'a4e5f3d1-ea43-4e13-9ff1-6a292d95146d', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:12:43Z', 'updated_at': '2021-05-31T16:12:52Z', 'revision_number': 5, 'project_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'subnets': [{'id': 'a4e5f3d1-ea43-4e13-9ff1-6a292d95146d', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '17b185b4-2ec5-4329-8f25-dffe73dec126'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:12:55.219592 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] Checking router: 91972da3-5db4-4114-848c-2ac4ccf9c8bd for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:12:55.219898 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] Updating router 91972da3-5db4-4114-848c-2ac4ccf9c8bd port f849b98d-c136-425a-a8fe-c7596ff6c309 binding host dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 31 16:12:55.283336 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:55.625626 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] Notify callbacks [] for port, precommit_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:55.637292 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] Transition to ACTIVE for port object f849b98d-c136-425a-a8fe-c7596ff6c309 will not be triggered until provisioned by entity L2. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:12:55.642931 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:55.646799 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:12:55.719226 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] Attempting to bind port f849b98d-c136-425a-a8fe-c7596ff6c309 on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:12:55.719603 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] Attempting to bind port f849b98d-c136-425a-a8fe-c7596ff6c309 by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:12:55.719972 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] Attempting to bind port f849b98d-c136-425a-a8fe-c7596ff6c309 on network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:12:55.730499 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 12, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:12:55.730895 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] Checking segment: {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91765) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:12:55.731282 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:55.731673 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] Bound using segment: {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:12:55.732146 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] Bound port: f849b98d-c136-425a-a8fe-c7596ff6c309, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:12:55.732521 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:55.756489 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86e89553-23fb-4873-a73f-553d56e481a9 None None] Pushing event updated for resources: {'Port': ['ID=f849b98d-c136-425a-a8fe-c7596ff6c309,revision_number=2']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:12:55.759360 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-86e89553-23fb-4873-a73f-553d56e481a9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:12:55.811451 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] For port f849b98d-c136-425a-a8fe-c7596ff6c309, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91765) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:12:55.815040 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] For port f849b98d-c136-425a-a8fe-c7596ff6c309, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=f849b98d-c136-425a-a8fe-c7596ff6c309,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91765) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:12:55.818625 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:55.822722 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:12:55.897038 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] Routers {'91972da3-5db4-4114-848c-2ac4ccf9c8bd'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:12:55.897697 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f142aac8ee0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:12:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['91972da3-5db4-4114-848c-2ac4ccf9c8bd'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:12:56.002971 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86e89553-23fb-4873-a73f-553d56e481a9 None None] Pushing event updated for resources: {'Port': ['ID=f849b98d-c136-425a-a8fe-c7596ff6c309,revision_number=3']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:12:56.009089 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-86e89553-23fb-4873-a73f-553d56e481a9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:12:56.115013 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] Set router 91972da3-5db4-4114-848c-2ac4ccf9c8bd gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:12:56.456406 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f142aac8ee0>, [{'id': '91972da3-5db4-4114-848c-2ac4ccf9c8bd', 'name': 'router1', 'tenant_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.16'}], 'enable_snat': True}, 'gw_port_id': 'f849b98d-c136-425a-a8fe-c7596ff6c309', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:12:34Z', 'updated_at': '2021-05-31T16:12:53Z', 'revision_number': 4, 'project_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'gw_port': {'id': 'f849b98d-c136-425a-a8fe-c7596ff6c309', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:96:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91972da3-5db4-4114-848c-2ac4ccf9c8bd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:12:53Z', 'updated_at': '2021-05-31T16:12:55Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': 'bd5e0a1e-5240-480a-a613-3bb2d871d5e4', 'name': '', 'network_id': 'e1a8e8fd-a72e-42dc-9b24-58627a309dc6', 'tenant_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'mac_address': 'fa:16:3e:44:2c:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91972da3-5db4-4114-848c-2ac4ccf9c8bd', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'a4e5f3d1-ea43-4e13-9ff1-6a292d95146d', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:12:43Z', 'updated_at': '2021-05-31T16:12:52Z', 'revision_number': 5, 'project_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'subnets': [{'id': 'a4e5f3d1-ea43-4e13-9ff1-6a292d95146d', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '17b185b4-2ec5-4329-8f25-dffe73dec126'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:12:56.460483 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5400c54-4b1b-4e72-813f-5b38845eeded None None] The sync data for ids ['91972da3-5db4-4114-848c-2ac4ccf9c8bd'] in dv-cinder-793814-1-iscsi is: [{'id': '91972da3-5db4-4114-848c-2ac4ccf9c8bd', 'name': 'router1', 'tenant_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.16'}], 'enable_snat': True}, 'gw_port_id': 'f849b98d-c136-425a-a8fe-c7596ff6c309', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:12:34Z', 'updated_at': '2021-05-31T16:12:53Z', 'revision_number': 4, 'project_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'gw_port': {'id': 'f849b98d-c136-425a-a8fe-c7596ff6c309', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:96:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91972da3-5db4-4114-848c-2ac4ccf9c8bd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:12:53Z', 'updated_at': '2021-05-31T16:12:55Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': 'bd5e0a1e-5240-480a-a613-3bb2d871d5e4', 'name': '', 'network_id': 'e1a8e8fd-a72e-42dc-9b24-58627a309dc6', 'tenant_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'mac_address': 'fa:16:3e:44:2c:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91972da3-5db4-4114-848c-2ac4ccf9c8bd', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'a4e5f3d1-ea43-4e13-9ff1-6a292d95146d', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:12:43Z', 'updated_at': '2021-05-31T16:12:52Z', 'revision_number': 5, 'project_id': '84ea5f4a2e6548cd9fda529a1fcd3262', 'subnets': [{'id': 'a4e5f3d1-ea43-4e13-9ff1-6a292d95146d', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '17b185b4-2ec5-4329-8f25-dffe73dec126'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:12:57.045068 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 55108) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:12:57.168138 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-3e128f8d-3568-42ee-9f19-46778bd575f4 admin admin] 10.222.0.43 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200  len: 410 time: 0.1218045
May 31 16:12:58.227395 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device f849b98d-c136-425a-a8fe-c7596ff6c309 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:12:58.317394 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port f849b98d-c136-425a-a8fe-c7596ff6c309 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:12:58.323880 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port f849b98d-c136-425a-a8fe-c7596ff6c309 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:12:58.324250 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:58.455043 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:58.481160 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port f849b98d-c136-425a-a8fe-c7596ff6c309, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=f849b98d-c136-425a-a8fe-c7596ff6c309,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:12:58.488903 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:12:58.494135 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:12:58.563718 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=f849b98d-c136-425a-a8fe-c7596ff6c309,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:12:58.567704 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:13:00.231978 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device f849b98d-c136-425a-a8fe-c7596ff6c309 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:13:00.316085 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port f849b98d-c136-425a-a8fe-c7596ff6c309 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:13:00.316688 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:13:05.005708 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-6a223208-6313-4b83-8625-6b7e50e6e860 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:13:07.848451 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:13:08.202035 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-fced1201-f87a-47dd-b5c7-ddcade08c464 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:13:09.080924 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:13:10.792809 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:13:11.170328 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 5 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:13:34.961069 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-a7aaedbf-f01f-4071-86f8-c50d40135ee6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:13:37.876682 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:13:38.216271 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-528f6521-47e8-4497-b071-2528437cda08 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:13:39.091259 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:13:40.828448 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:13:48.168949 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 5 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:14:04.964046 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-9f2427d9-6bb7-40e3-8695-b5911ba15c76 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:14:07.853928 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:14:08.212024 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-6d7a0c65-b318-430a-b075-5c285a8967e8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:14:09.088232 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:14:10.791568 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:14:25.168066 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 5 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:14:34.821866 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 55680) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:14:34.891400 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.pecan_wsgi.hooks.translation [None req-e879634d-23d4-4314-99c9-8eb06db80e78 admin admin] GET failed (client error): The resource could not be found.
May 31 16:14:34.893292 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-e879634d-23d4-4314-99c9-8eb06db80e78 admin admin] 10.222.0.43 "GET /v2.0/networks/private HTTP/1.1" status: 404  len: 315 time: 0.0704677
May 31 16:14:34.969013 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-1f680cbc-6223-4ab4-a5f8-8c1e4a11b6a0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:14:35.038029 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-650a5b8f-ec4c-4451-b6d9-b5b6674b791d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:14:35.039518 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-650a5b8f-ec4c-4451-b6d9-b5b6674b791d admin admin] 10.222.0.43 "GET /v2.0/networks?name=private HTTP/1.1" status: 200  len: 872 time: 0.1423955
May 31 16:14:37.294719 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 55690) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:14:37.414104 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed236bbf-fadc-4eae-8fd7-08f057c7ecf9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:14:37.414664 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-ed236bbf-fadc-4eae-8fd7-08f057c7ecf9 admin admin] Synchronizing usage tracker for tenant:62d3939038d943a283e167c51790b574 on resource:subnet {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:14:37.436914 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-ed236bbf-fadc-4eae-8fd7-08f057c7ecf9 admin admin] Unset dirty status for tenant:62d3939038d943a283e167c51790b574 on resource:subnet {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:14:37.438454 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-ed236bbf-fadc-4eae-8fd7-08f057c7ecf9 admin admin] 10.222.0.43 "GET /v2.0/subnets/a4e5f3d1-ea43-4e13-9ff1-6a292d95146d HTTP/1.1" status: 200  len: 849 time: 0.1423438
May 31 16:14:37.449147 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-0fe1c3e3-5c29-4652-9d5b-8b7623049a73 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:14:37.573076 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-0fe1c3e3-5c29-4652-9d5b-8b7623049a73 admin admin] Notify callbacks [] for subnet, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:14:37.784039 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-0fe1c3e3-5c29-4652-9d5b-8b7623049a73 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8732784445341'] for subnet, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:14:37.792455 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-b2f21540-d749-4825-af7b-be7dcd799bfb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:14:37.858201 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0fe1c3e3-5c29-4652-9d5b-8b7623049a73 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:14:37.858745 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-0fe1c3e3-5c29-4652-9d5b-8b7623049a73 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:14:37.860954 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-0fe1c3e3-5c29-4652-9d5b-8b7623049a73 admin admin] 10.222.0.43 "PUT /v2.0/subnets/a4e5f3d1-ea43-4e13-9ff1-6a292d95146d HTTP/1.1" status: 200  len: 868 time: 0.4155307
May 31 16:14:37.863672 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d99675b-9bbe-4e0d-a507-c5ddcecda521 None None] Network e1a8e8fd-a72e-42dc-9b24-58627a309dc6 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:14:37.896749 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:14:37.915617 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fe1c3e3-5c29-4652-9d5b-8b7623049a73 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a4e5f3d1-ea43-4e13-9ff1-6a292d95146d,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:14:37.929008 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe1c3e3-5c29-4652-9d5b-8b7623049a73 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:14:37.929554 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe1c3e3-5c29-4652-9d5b-8b7623049a73 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:14:37.930106 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe1c3e3-5c29-4652-9d5b-8b7623049a73 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:14:37.930637 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe1c3e3-5c29-4652-9d5b-8b7623049a73 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:14:37.931161 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe1c3e3-5c29-4652-9d5b-8b7623049a73 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:14:37.931988 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe1c3e3-5c29-4652-9d5b-8b7623049a73 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:14:37.932525 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe1c3e3-5c29-4652-9d5b-8b7623049a73 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:14:37.933055 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe1c3e3-5c29-4652-9d5b-8b7623049a73 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:14:37.933640 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe1c3e3-5c29-4652-9d5b-8b7623049a73 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:14:37.934177 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe1c3e3-5c29-4652-9d5b-8b7623049a73 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:14:37.934701 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe1c3e3-5c29-4652-9d5b-8b7623049a73 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:14:37.935217 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe1c3e3-5c29-4652-9d5b-8b7623049a73 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:14:37.942325 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-0fe1c3e3-5c29-4652-9d5b-8b7623049a73 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:14:38.258540 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-099f6390-61ad-42f0-8b3c-db282f6bf02a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:14:38.492793 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-61339647-67ea-486a-8246-f944b2d804cb None None] Provisioning complete for port bd5e0a1e-5240-480a-a613-3bb2d871d5e4 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:14:38.493179 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-61339647-67ea-486a-8246-f944b2d804cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:14:38.675732 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-61339647-67ea-486a-8246-f944b2d804cb None None] Provisioning complete for port 3959291f-f70a-4e4e-aa0f-f98709aace03 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:14:38.676268 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-61339647-67ea-486a-8246-f944b2d804cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:14:39.101773 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:14:40.085969 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 55700) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:14:40.324334 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f77c30d1-d9fd-4eac-8415-a9b3ef480f53 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:14:40.324809 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f77c30d1-d9fd-4eac-8415-a9b3ef480f53 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:14:40.326419 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-f77c30d1-d9fd-4eac-8415-a9b3ef480f53 admin admin] 10.222.0.43 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.2392697
May 31 16:14:40.797756 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:14:42.656141 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 55710) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:14:42.851608 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e08e8fc-0931-4013-82a9-5c83d37ccda4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:14:42.851986 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e08e8fc-0931-4013-82a9-5c83d37ccda4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:14:42.853495 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-4e08e8fc-0931-4013-82a9-5c83d37ccda4 admin admin] 10.222.0.43 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.1963515
May 31 16:14:45.041845 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 55720) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:14:45.236372 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3470490e-f8e8-4fd2-9f6f-1f085903b3c1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:14:45.238135 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-3470490e-f8e8-4fd2-9f6f-1f085903b3c1 admin admin] 10.222.0.43 "GET /v2.0/networks/00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c HTTP/1.1" status: 200  len: 886 time: 0.1950381
May 31 16:14:47.434952 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 55730) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:14:47.620995 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5894e3b5-11de-490e-9987-f921ae8d6d06 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:14:47.622366 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-5894e3b5-11de-490e-9987-f921ae8d6d06 admin admin] 10.222.0.43 "GET /v2.0/networks/e1a8e8fd-a72e-42dc-9b24-58627a309dc6 HTTP/1.1" status: 200  len: 869 time: 0.1864586
May 31 16:14:49.808776 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 55740) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:14:49.931330 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f45405c0-5650-461e-9396-55ba165e63f0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:14:49.931794 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f45405c0-5650-461e-9396-55ba165e63f0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:14:49.933324 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-f45405c0-5650-461e-9396-55ba165e63f0 admin admin] 10.222.0.43 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1236088
May 31 16:14:52.154888 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 55750) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:14:52.300095 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21339273-0f3d-49aa-b078-e553e7920ff8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:14:52.300793 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21339273-0f3d-49aa-b078-e553e7920ff8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:14:52.303367 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-21339273-0f3d-49aa-b078-e553e7920ff8 admin admin] 10.222.0.43 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1473045
May 31 16:14:54.517829 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 55760) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:14:54.629098 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-280dc442-2d23-4e04-9561-f7747334f95f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:14:54.630455 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-280dc442-2d23-4e04-9561-f7747334f95f admin admin] 10.222.0.43 "GET /v2.0/subnets/96709d85-d0fe-4cf8-b232-eaf6b143ebe6 HTTP/1.1" status: 200  len: 816 time: 0.1113918
May 31 16:14:56.835567 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 55770) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:14:56.950977 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1bec1bc0-b3fb-452d-8f05-9036a74a582a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:14:56.952336 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-1bec1bc0-b3fb-452d-8f05-9036a74a582a admin admin] 10.222.0.43 "GET /v2.0/subnets/a4e5f3d1-ea43-4e13-9ff1-6a292d95146d HTTP/1.1" status: 200  len: 868 time: 0.1157849
May 31 16:15:02.167303 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 5 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:15:04.974067 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-198095d1-745a-45e4-ab8c-84ef35370614 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:07.863537 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:08.206708 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-8f07591c-792b-4d31-a644-3df6a74ed3ae None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:09.094259 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:10.805619 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:21.000075 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 55814) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:15:21.055492 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [None req-92bdfa5b-b018-48f3-bfa5-a85187d821c5 admin admin] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=91763) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 31 16:15:21.056466 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-92bdfa5b-b018-48f3-bfa5-a85187d821c5 admin admin] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0554130
May 31 16:15:23.344714 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 55824) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:15:23.415494 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.pecan_wsgi.hooks.translation [None req-478d3900-e58a-4e63-85b0-b8a033c1b27d admin admin] GET failed (client error): The resource could not be found.
May 31 16:15:23.416787 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-478d3900-e58a-4e63-85b0-b8a033c1b27d admin admin] 10.222.0.43 "GET /v2.0/networks/public HTTP/1.1" status: 404  len: 314 time: 0.0711002
May 31 16:15:23.546704 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5cc7684-5320-437b-a4a5-e42ba53ba111 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:15:23.548180 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-c5cc7684-5320-437b-a4a5-e42ba53ba111 admin admin] 10.222.0.43 "GET /v2.0/networks?name=public HTTP/1.1" status: 200  len: 889 time: 0.1273396
May 31 16:15:25.768858 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 55834) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:15:25.818425 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-68270979-bea9-4427-97af-7b9e3376b199 admin admin] Request body: {'network': {'shared': True, 'name': 'shared', 'admin_state_up': True}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:15:25.823516 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-68270979-bea9-4427-97af-7b9e3376b199 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:15:25.834003 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-68270979-bea9-4427-97af-7b9e3376b199 admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:15:25.843070 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-68270979-bea9-4427-97af-7b9e3376b199 admin admin] Made reservation on behalf of 62d3939038d943a283e167c51790b574 for: {'network': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:15:25.846488 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-68270979-bea9-4427-97af-7b9e3376b199 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-639279'] for network, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:25.938979 dv-cinder-793814-1-iscsi neutron-server[91764]: WARNING neutron.services.revisions.revision_plugin [None req-68270979-bea9-4427-97af-7b9e3376b199 admin admin] Could not find related network for resource <neutron.db.rbac_db_models.NetworkRBAC[object at 7f142675ab20] {project_id='62d3939038d943a283e167c51790b574', id='4668da2c-ee1a-40b0-9921-95e4b24a06df', target_tenant='*', action='access_as_shared', object_id='212ab211-7c76-4934-acfc-01c978c3aca3'}> to bump revision.
May 31 16:15:25.951635 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-68270979-bea9-4427-97af-7b9e3376b199 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 810}  {{(pid=91764) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 31 16:15:25.961373 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-68270979-bea9-4427-97af-7b9e3376b199 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:25.961760 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.db.segments_db [None req-68270979-bea9-4427-97af-7b9e3376b199 admin admin] Added segment a40252b3-1b75-4d21-8156-a52375347d5c of type vlan for network 212ab211-7c76-4934-acfc-01c978c3aca3
May 31 16:15:25.989873 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-68270979-bea9-4427-97af-7b9e3376b199 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732784079930'] for network, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:26.023343 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-68270979-bea9-4427-97af-7b9e3376b199 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366'] for network, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:26.024751 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68270979-bea9-4427-97af-7b9e3376b199 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:15:26.025336 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-68270979-bea9-4427-97af-7b9e3376b199 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:26.028698 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:15:26.131428 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68270979-bea9-4427-97af-7b9e3376b199 admin admin] Pushing event updated for resources: {'Network': ['ID=212ab211-7c76-4934-acfc-01c978c3aca3,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:15:26.135273 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-68270979-bea9-4427-97af-7b9e3376b199 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.3653684
May 31 16:15:26.136024 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-68270979-bea9-4427-97af-7b9e3376b199 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:15:26.143610 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Network 212ab211-7c76-4934-acfc-01c978c3aca3 details requested by agent ovs-agent-dv-cinder-793814-1-iscsi with host dv-cinder-793814-1-iscsi {{(pid=91765) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 31 16:15:28.342869 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 55844) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:15:28.418628 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.pecan_wsgi.hooks.translation [None req-54cfa64f-037b-45a1-ba0c-9828ea0aa07f admin admin] GET failed (client error): The resource could not be found.
May 31 16:15:28.419930 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-54cfa64f-037b-45a1-ba0c-9828ea0aa07f admin admin] 10.222.0.43 "GET /v2.0/networks/shared HTTP/1.1" status: 404  len: 314 time: 0.0755908
May 31 16:15:28.528480 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e2763e2-233e-4e9d-8663-b496367a42fd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:15:28.529864 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-8e2763e2-233e-4e9d-8663-b496367a42fd admin admin] 10.222.0.43 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200  len: 826 time: 0.1053367
May 31 16:15:28.539727 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Request body: {'subnet': {'cidr': '192.168.233.0/24', 'network_id': '212ab211-7c76-4934-acfc-01c978c3aca3', 'ip_version': 4, 'description': 'shared-subnet', 'name': 'shared-subnet'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:15:28.544916 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:15:28.555135 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:15:28.565666 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Made reservation on behalf of 62d3939038d943a283e167c51790b574 for: {'subnet': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:15:28.567885 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:28.985993 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357'] for subnet, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:28.989664 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:15:29.062590 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=47a67de8-eac8-4eef-b09c-ca63cc33d90c,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:15:29.073243 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.073626 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.073964 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.074287 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.074607 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.074926 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.075240 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.075554 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.075885 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.076196 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.076505 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.076923 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.079963 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Checking segment: {'id': 'a40252b3-1b75-4d21-8156-a52375347d5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 810, 'network_id': '212ab211-7c76-4934-acfc-01c978c3aca3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91763) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:15:29.080318 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Network hostable DHCP agents. Network: 212ab211-7c76-4934-acfc-01c978c3aca3, hostable agents: ['5c9859e8-5965-4c86-8b2b-8fab235cbf66'], hosted agents: [] {{(pid=91763) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 31 16:15:29.083190 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:15:29.098363 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Network 212ab211-7c76-4934-acfc-01c978c3aca3 is scheduled to be hosted by DHCP agent 5c9859e8-5965-4c86-8b2b-8fab235cbf66 with binding_index 1 {{(pid=91763) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 31 16:15:29.107710 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793814-1-iscsi, 212ab211-7c76-4934-acfc-01c978c3aca3) {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:15:29.112325 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:15:29.112899 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:29.117350 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-133e7f85-1e5a-44ef-8a6e-7b8bf0668646 None None] Network 212ab211-7c76-4934-acfc-01c978c3aca3 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:15:29.142827 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.6065619
May 31 16:15:29.345273 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp87ca72be-1027-56d4-a8d3-ba9dae998815-212ab211-7c76-4934-acfc-01c978c3aca3', 'network_id': '212ab211-7c76-4934-acfc-01c978c3aca3', 'tenant_id': '62d3939038d943a283e167c51790b574', 'fixed_ips': [{'subnet_id': '47a67de8-eac8-4eef-b09c-ca63cc33d90c'}]}} from dv-cinder-793814-1-iscsi. {{(pid=91765) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 31 16:15:29.346183 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:29.513546 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.db_base_plugin_common [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Allocated IP 192.168.233.2 (212ab211-7c76-4934-acfc-01c978c3aca3/47a67de8-eac8-4eef-b09c-ca63cc33d90c/60db96f5-06af-4bd8-8d6d-5f653345b183) {{(pid=91765) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:15:29.723764 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Notify callbacks [] for port, precommit_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:29.734746 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Transition to ACTIVE for port object 60db96f5-06af-4bd8-8d6d-5f653345b183 will not be triggered until provisioned by entity L2. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:15:29.754717 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Transition to ACTIVE for port object 60db96f5-06af-4bd8-8d6d-5f653345b183 will not be triggered until provisioned by entity DHCP. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:15:29.762019 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:29.771742 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-fabd3325-c7f2-4db0-8162-7902e540c211 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:15:29.835486 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Network 212ab211-7c76-4934-acfc-01c978c3aca3 is already hosted by enough agents. {{(pid=91765) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:15:29.838369 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.scheduler.base_scheduler [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Resources bound (agent type, host, resource id):  {{(pid=91765) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:15:29.844205 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Received port after_create {{(pid=91765) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:15:29.853677 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Pushing event updated for resources: {'Port': ['ID=60db96f5-06af-4bd8-8d6d-5f653345b183,revision_number=1']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:15:29.889109 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.889455 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.889868 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.890207 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.890545 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.890953 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.891289 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.891612 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.891972 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.892290 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.892621 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.892945 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:15:29.901411 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:15:29.957143 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Attempting to bind port 60db96f5-06af-4bd8-8d6d-5f653345b183 on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:15:29.957513 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Attempting to bind port 60db96f5-06af-4bd8-8d6d-5f653345b183 by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': 'a40252b3-1b75-4d21-8156-a52375347d5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 810, 'network_id': '212ab211-7c76-4934-acfc-01c978c3aca3'}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:15:29.957908 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Attempting to bind port 60db96f5-06af-4bd8-8d6d-5f653345b183 on network 212ab211-7c76-4934-acfc-01c978c3aca3 {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:15:29.963380 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 15, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:15:29.963753 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Checking segment: {'id': 'a40252b3-1b75-4d21-8156-a52375347d5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 810, 'network_id': '212ab211-7c76-4934-acfc-01c978c3aca3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91765) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:15:29.964159 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:29.964546 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Bound using segment: {'id': 'a40252b3-1b75-4d21-8156-a52375347d5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 810, 'network_id': '212ab211-7c76-4934-acfc-01c978c3aca3'} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:15:29.965016 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Bound port: 60db96f5-06af-4bd8-8d6d-5f653345b183, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a40252b3-1b75-4d21-8156-a52375347d5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 810, 'network_id': '212ab211-7c76-4934-acfc-01c978c3aca3'}}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:15:29.965390 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:30.059642 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] For port 60db96f5-06af-4bd8-8d6d-5f653345b183, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91765) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:15:30.063716 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] For port 60db96f5-06af-4bd8-8d6d-5f653345b183, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=60db96f5-06af-4bd8-8d6d-5f653345b183,segment=NetworkSegment(a40252b3-1b75-4d21-8156-a52375347d5c),segment_id=a40252b3-1b75-4d21-8156-a52375347d5c)] {{(pid=91765) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:15:30.067434 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:30.071535 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:15:30.151487 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Pushing event updated for resources: {'Port': ['ID=60db96f5-06af-4bd8-8d6d-5f653345b183,revision_number=2']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:15:30.156869 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:15:30.968955 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bdade4ce-8340-49e6-93fa-0a2d09c26bea None None] Network 212ab211-7c76-4934-acfc-01c978c3aca3 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:15:31.078806 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-6a6a18d2-c5cd-405a-a1c8-e0fb5454b1f7 None None] Provisioning for port 60db96f5-06af-4bd8-8d6d-5f653345b183 completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:15:32.345499 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 60db96f5-06af-4bd8-8d6d-5f653345b183 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:15:32.416992 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port 60db96f5-06af-4bd8-8d6d-5f653345b183 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:15:32.423005 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 60db96f5-06af-4bd8-8d6d-5f653345b183 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:15:32.423403 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:32.548289 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:32.584717 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port 60db96f5-06af-4bd8-8d6d-5f653345b183, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=60db96f5-06af-4bd8-8d6d-5f653345b183,segment=NetworkSegment(a40252b3-1b75-4d21-8156-a52375347d5c),segment_id=a40252b3-1b75-4d21-8156-a52375347d5c)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:15:32.589178 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:32.592328 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:15:32.663316 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=60db96f5-06af-4bd8-8d6d-5f653345b183,revision_number=3']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:15:32.668421 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:15:34.325068 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 60db96f5-06af-4bd8-8d6d-5f653345b183 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:15:34.397678 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 60db96f5-06af-4bd8-8d6d-5f653345b183 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:15:34.398049 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:34.978811 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-ae2f585e-4e36-4dcb-9bf3-4f3db0c5dc29 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:37.861638 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:38.200257 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-3c6e8433-5fe1-4258-a04d-4eb240265bf2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:39.097407 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:15:39.165980 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 5 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:15:40.802899 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:16:04.980534 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-297c3d5c-2e81-415a-937f-1e7a3b8a508e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:16:07.856346 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:16:08.203895 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-e39dc5d1-4b80-41f0-8358-4172907c80f5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:16:09.100990 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:16:10.805755 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:16:16.164935 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 5 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:16:34.986894 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-5ed909d0-0649-42e0-9b4d-54df3cf210a3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:16:37.860471 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:16:38.205726 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-6b380aaa-f8b2-4b3d-b759-9dc9f9980a0b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:16:39.102382 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:16:40.810159 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:16:43.489077 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 55894) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:16:43.495341 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [None req-fe2d5d15-dfc9-43d4-a994-d565c4658380 tempest-verify_tempest_config-1735208618 tempest-verify_tempest_config-1735208618-project] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=91763) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 31 16:16:43.496385 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-fe2d5d15-dfc9-43d4-a994-d565c4658380 tempest-verify_tempest_config-1735208618 tempest-verify_tempest_config-1735208618-project] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13635 time: 0.0061135
May 31 16:16:43.812362 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 55912) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:16:43.929685 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:16:43.947492 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:16:43.951929 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Usage tracker for resource:security_group_rule and tenant:2c64ac2e2b814f3ebf9ee4916d8690ce is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:16:43.955166 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:16:43.960801 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:16:44.055773 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:16:44.060288 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:16:44.067007 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:16:44.106963 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=2c64ac2e2b814f3ebf9ee4916d8690ce&name=default HTTP/1.1" status: 200  len: 2975 time: 0.2932000
May 31 16:16:44.107791 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=47afe5fd-c179-4efc-901f-9b6509ef711c,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:16:44.109603 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 55918) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:16:44.114665 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.115026 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.115361 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.115688 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.116011 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.116350 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.116670 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.116985 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.117300 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.117636 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.117953 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.118263 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.123814 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:16:44.178995 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-a44478e3-a5d0-411e-b18e-91294cdff4b5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:16:44.205641 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-a44478e3-a5d0-411e-b18e-91294cdff4b5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:16:44.303819 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-a44478e3-a5d0-411e-b18e-91294cdff4b5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:16:44.307863 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:16:44.322721 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a44478e3-a5d0-411e-b18e-91294cdff4b5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=47afe5fd-c179-4efc-901f-9b6509ef711c,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:16:44.330461 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-a44478e3-a5d0-411e-b18e-91294cdff4b5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:16:44.331554 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-a44478e3-a5d0-411e-b18e-91294cdff4b5 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/47afe5fd-c179-4efc-901f-9b6509ef711c HTTP/1.1" status: 204  len: 168 time: 0.2209699
May 31 16:16:44.332964 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a44478e3-a5d0-411e-b18e-91294cdff4b5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.333313 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a44478e3-a5d0-411e-b18e-91294cdff4b5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.333689 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a44478e3-a5d0-411e-b18e-91294cdff4b5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.334274 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a44478e3-a5d0-411e-b18e-91294cdff4b5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.334413 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a44478e3-a5d0-411e-b18e-91294cdff4b5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.334743 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a44478e3-a5d0-411e-b18e-91294cdff4b5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.335069 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a44478e3-a5d0-411e-b18e-91294cdff4b5 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.335483 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a44478e3-a5d0-411e-b18e-91294cdff4b5 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.335695 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a44478e3-a5d0-411e-b18e-91294cdff4b5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.336015 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a44478e3-a5d0-411e-b18e-91294cdff4b5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.336330 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a44478e3-a5d0-411e-b18e-91294cdff4b5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.336644 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a44478e3-a5d0-411e-b18e-91294cdff4b5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:16:44.339746 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-a44478e3-a5d0-411e-b18e-91294cdff4b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:16:53.164256 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 5 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:17:04.984902 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-a58026f3-f98f-4484-bae8-df69e07f4eb9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:17:07.862303 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:17:08.208616 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-24a53db0-299d-40f5-ae1e-6fc500cf8065 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:17:09.105054 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:17:10.811362 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:17:30.163605 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 5 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:17:34.977711 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-dfddeda9-c28e-4f49-b7dc-53166ce38ba9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:17:37.865380 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:17:38.209285 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-37084d18-9727-4658-9735-0e0aa30f55e6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:17:39.106538 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:17:40.813387 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:18:04.981634 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-62861f7d-9db4-4802-b101-60f6e6b1165a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:18:07.162605 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 5 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:18:07.867591 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:18:08.210931 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-9feb1121-1590-414e-8f46-e4360541aa1f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:18:09.110251 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:18:10.815961 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:18:17.587286 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222'] for agent, after_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:18:22.003516 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 55970) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:18:22.114971 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-54fe2620-af58-45b4-84fa-b56d316ea8a9 admin admin] 10.222.0.43 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.1103597
May 31 16:18:24.252496 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 55980) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:18:24.308829 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-95f228bf-68d5-4ea4-b7d8-75263aebfe59 admin admin] 10.222.0.43 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.0552344
May 31 16:18:34.984889 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-c57115d7-70a1-4e8e-9986-3f6b671e8bf8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:18:37.870835 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:18:38.212940 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-5cf24647-fcee-412e-9cc4-8288e96e4527 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:18:39.112391 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:18:40.818960 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:18:44.161848 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:18:47.560309 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:04.991047 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-501f3464-1a53-407d-8909-99bc699e5d6c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:07.874850 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:08.214095 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-6e4a745f-b58a-4e56-8650-2b9ea61db2c4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:09.117792 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:10.823019 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:17.565663 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:21.160306 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:19:34.982807 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0bab8d85-e80e-40d9-a437-36c259d331fb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:37.878066 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:38.215052 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-b44620fa-f469-4044-bf66-666bd0c5922b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:39.119390 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:40.827096 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:47.581851 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:53.588025 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 56154) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:19:53.719364 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 56170) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:19:53.883140 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-884071623-network', 'tenant_id': '12203182731d4a61acb7fc5914aef425'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:19:53.890594 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:19:53.897183 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Usage tracker for resource:network and tenant:12203182731d4a61acb7fc5914aef425 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:19:53.902209 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:19:53.911043 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:19:53.924698 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Made reservation on behalf of 12203182731d4a61acb7fc5914aef425 for: {'network': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:19:53.925461 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-639279'] for network, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:53.938150 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:53.954534 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:19:53.958911 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Usage tracker for resource:security_group_rule and tenant:12203182731d4a61acb7fc5914aef425 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:19:53.962915 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:19:53.969214 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:19:53.991769 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-170213081-network', 'tenant_id': '0eb6e65b3f844417816fb1e5c88a8004'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:19:54.004377 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:19:54.010758 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Usage tracker for resource:network and tenant:0eb6e65b3f844417816fb1e5c88a8004 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:19:54.014610 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:19:54.021953 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:19:54.035467 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Made reservation on behalf of 0eb6e65b3f844417816fb1e5c88a8004 for: {'network': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:19:54.038785 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-639279'] for network, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:54.056212 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:54.077812 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:19:54.081277 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:54.084359 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Usage tracker for resource:security_group_rule and tenant:0eb6e65b3f844417816fb1e5c88a8004 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:19:54.089075 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:54.090381 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:19:54.092901 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:19:54.100470 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:19:54.145598 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 806}  {{(pid=91764) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 31 16:19:54.156747 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:54.157357 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.db.segments_db [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Added segment 39cd3b8c-a501-4003-900e-4c3bab514801 of type vlan for network be7d7603-734f-43bb-92a8-ed07a835aeb5
May 31 16:19:54.186700 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732784079930'] for network, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:54.203918 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ef04aa34-ac88-44ba-87b5-bcf65d42774f,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:19:54.244349 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.244948 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.245441 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.245600 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:54.246110 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.246405 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.246902 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.247470 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.248244 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.248765 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.249279 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.249810 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.250335 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.251294 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Tracked resource versions report:
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]: pushed versions:
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]: {   'AddressGroup': {'1.2'},
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:     'ConntrackHelper': {'1.0'},
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:     'Log': {'1.0'},
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:     'Network': {'1.1'},
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:     'Port': {'1.7'},
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:     'PortForwarding': {'1.2'},
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:     'QosPolicy': {'1.8'},
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:     'SecurityGroup': {'1.4'},
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:     'SecurityGroupRule': {'1.2'},
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:     'SubPort': {'1.0'},
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:     'Subnet': {'1.1'},
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:     'Trunk': {'1.1'}}
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]: consumer versions:
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]: {   DHCP agent@dv-cinder-793814-1-iscsi: {},
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:     HyperV agent@hv-cinder-79381: {},
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:     L3 agent@dv-cinder-793814-1-iscsi: {},
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:     Metadata agent@dv-cinder-793814-1-iscsi: {},
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:     Metering agent@dv-cinder-793814-1-iscsi: {},
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:     Open vSwitch agent@dv-cinder-793814-1-iscsi: {   'AddressGroup': '1.2',
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'ConntrackHelper': '1.0',
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'Log': '1.0',
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'Network': '1.1',
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'Port': '1.7',
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'PortForwarding': '1.2',
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'QosPolicy': '1.8',
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'SecurityGroup': '1.4',
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'SecurityGroupRule': '1.2',
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'SubPort': '1.0',
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'Subnet': '1.1',
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:                                                      'Trunk': '1.1'}}
May 31 16:19:54.251924 dv-cinder-793814-1-iscsi neutron-server[91764]:  {{(pid=91764) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 31 16:19:54.258136 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366'] for network, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:54.258920 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:19:54.260402 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:19:54.263470 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:19:54.265190 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:54.278139 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-91778ca4-e35d-4037-964c-b35a391273f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:19:54.309491 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 838}  {{(pid=91763) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 31 16:19:54.321439 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 56198) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:19:54.321744 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201  len: 889 time: 0.7322769
May 31 16:19:54.330834 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=860b379b-4832-4cf9-9ec8-1baa2d76c182,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:19:54.340469 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-2bc1a6f6-414f-4ad6-9741-57ef63456ce0 admin admin] Request body: {'subnet': {'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-subnet', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:19:54.350288 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8732784586213', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:54.351124 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7f14285ede50> segment precommit_create {{(pid=91763) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
May 31 16:19:54.351731 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.segments_db [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Added segment 016e9daa-b906-4ec8-978d-cb58fbcd78da of type vlan for network 1097eeec-06a4-406d-ab4a-02e0123072d2
May 31 16:19:54.360353 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.360977 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.361494 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.361859 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.362245 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.362595 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.362917 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.363408 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.363749 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.364236 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.364730 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.365214 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Tracked resource versions report:
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]: pushed versions:
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]: {   'AddressGroup': {'1.2'},
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:     'ConntrackHelper': {'1.0'},
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:     'Log': {'1.0'},
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:     'Network': {'1.1'},
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:     'Port': {'1.7'},
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:     'PortForwarding': {'1.2'},
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:     'QosPolicy': {'1.8'},
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:     'SecurityGroup': {'1.4'},
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:     'SecurityGroupRule': {'1.2'},
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:     'SubPort': {'1.0'},
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:     'Subnet': {'1.1'},
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:     'Trunk': {'1.1'}}
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]: consumer versions:
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]: {   DHCP agent@dv-cinder-793814-1-iscsi: {},
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:     HyperV agent@hv-cinder-79381: {},
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:     L3 agent@dv-cinder-793814-1-iscsi: {},
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:     Metadata agent@dv-cinder-793814-1-iscsi: {},
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:     Metering agent@dv-cinder-793814-1-iscsi: {},
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:     Open vSwitch agent@dv-cinder-793814-1-iscsi: {   'AddressGroup': '1.2',
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'ConntrackHelper': '1.0',
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'Log': '1.0',
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'Network': '1.1',
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'Port': '1.7',
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'PortForwarding': '1.2',
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'QosPolicy': '1.8',
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'SecurityGroup': '1.4',
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'SecurityGroupRule': '1.2',
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'SubPort': '1.0',
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'Subnet': '1.1',
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:                                                      'Trunk': '1.1'}}
May 31 16:19:54.366563 dv-cinder-793814-1-iscsi neutron-server[91763]:  {{(pid=91763) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 31 16:19:54.382972 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:19:54.386131 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-2bc1a6f6-414f-4ad6-9741-57ef63456ce0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:19:54.396023 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-2bc1a6f6-414f-4ad6-9741-57ef63456ce0 admin admin] Usage tracker for resource:subnet and tenant:12203182731d4a61acb7fc5914aef425 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:19:54.400909 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Pushing event updated for resources: {'Network': ['ID=be7d7603-734f-43bb-92a8-ed07a835aeb5,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:19:54.403984 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:19:54.404346 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-2bc1a6f6-414f-4ad6-9741-57ef63456ce0 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:19:54.411808 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Network be7d7603-734f-43bb-92a8-ed07a835aeb5 details requested by agent ovs-agent-dv-cinder-793814-1-iscsi with host dv-cinder-793814-1-iscsi {{(pid=91765) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 31 16:19:54.423266 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-2bc1a6f6-414f-4ad6-9741-57ef63456ce0 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:19:54.428896 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732784079930'] for network, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:54.457661 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2bc1a6f6-414f-4ad6-9741-57ef63456ce0 admin admin] Made reservation on behalf of 12203182731d4a61acb7fc5914aef425 for: {'subnet': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:19:54.460157 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2bc1a6f6-414f-4ad6-9741-57ef63456ce0 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:54.558310 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 56208) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:19:54.585562 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366'] for network, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:54.588856 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:19:54.589448 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:54.595404 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:19:54.767077 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Pushing event updated for resources: {'Network': ['ID=1097eeec-06a4-406d-ab4a-02e0123072d2,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:19:54.797936 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Network 1097eeec-06a4-406d-ab4a-02e0123072d2 details requested by agent ovs-agent-dv-cinder-793814-1-iscsi with host dv-cinder-793814-1-iscsi {{(pid=91765) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 31 16:19:54.807622 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 56224) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:19:54.810367 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:19:54.839899 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 1.1194227
May 31 16:19:54.843004 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 56234) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:19:54.849332 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-aa1609a4-40c2-4ee1-bfca-eb3403798799 admin admin] Request body: {'subnet': {'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-170213081-subnet', 'tenant_id': '0eb6e65b3f844417816fb1e5c88a8004', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:19:54.856300 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-aa1609a4-40c2-4ee1-bfca-eb3403798799 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:19:54.864355 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-aa1609a4-40c2-4ee1-bfca-eb3403798799 admin admin] Usage tracker for resource:subnet and tenant:0eb6e65b3f844417816fb1e5c88a8004 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:19:54.873242 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-aa1609a4-40c2-4ee1-bfca-eb3403798799 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:19:54.890688 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-aa1609a4-40c2-4ee1-bfca-eb3403798799 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:19:54.915114 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa1609a4-40c2-4ee1-bfca-eb3403798799 admin admin] Made reservation on behalf of 0eb6e65b3f844417816fb1e5c88a8004 for: {'subnet': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:19:54.921271 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-aa1609a4-40c2-4ee1-bfca-eb3403798799 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:55.049893 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2bc1a6f6-414f-4ad6-9741-57ef63456ce0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357'] for subnet, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:55.060787 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d3898611-bbf9-4846-b9b0-e6282e5d8ae8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:19:55.102956 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1748311148-network', 'tenant_id': '1739d3c0e2734c8a9af5c5291aac8e25'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:19:55.114254 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:19:55.119976 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bc1a6f6-414f-4ad6-9741-57ef63456ce0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=eb5363fe-ee39-4adc-b299-6098caad681d,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:19:55.127536 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-2bc1a6f6-414f-4ad6-9741-57ef63456ce0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:19:55.127683 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Usage tracker for resource:network and tenant:1739d3c0e2734c8a9af5c5291aac8e25 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:19:55.132643 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:19:55.142316 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:19:55.162917 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bc1a6f6-414f-4ad6-9741-57ef63456ce0 admin admin] Checking segment: {'id': '39cd3b8c-a501-4003-900e-4c3bab514801', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 806, 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91763) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:19:55.163287 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2bc1a6f6-414f-4ad6-9741-57ef63456ce0 admin admin] Network hostable DHCP agents. Network: be7d7603-734f-43bb-92a8-ed07a835aeb5, hostable agents: ['5c9859e8-5965-4c86-8b2b-8fab235cbf66'], hosted agents: [] {{(pid=91763) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 31 16:19:55.174581 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Made reservation on behalf of 1739d3c0e2734c8a9af5c5291aac8e25 for: {'network': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:19:55.177167 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-639279'] for network, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:55.185981 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2bc1a6f6-414f-4ad6-9741-57ef63456ce0 admin admin] Network be7d7603-734f-43bb-92a8-ed07a835aeb5 is scheduled to be hosted by DHCP agent 5c9859e8-5965-4c86-8b2b-8fab235cbf66 with binding_index 1 {{(pid=91763) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 31 16:19:55.200471 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-2bc1a6f6-414f-4ad6-9741-57ef63456ce0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793814-1-iscsi, be7d7603-734f-43bb-92a8-ed07a835aeb5) {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:19:55.203783 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:55.210748 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fdb87e48-677f-43e2-81a1-daac12cc9195 None None] Network be7d7603-734f-43bb-92a8-ed07a835aeb5 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:19:55.228113 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:19:55.232542 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2bc1a6f6-414f-4ad6-9741-57ef63456ce0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:19:55.233204 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2bc1a6f6-414f-4ad6-9741-57ef63456ce0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:55.250763 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Usage tracker for resource:security_group_rule and tenant:1739d3c0e2734c8a9af5c5291aac8e25 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:19:55.256995 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:19:55.266982 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:19:55.276345 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-2bc1a6f6-414f-4ad6-9741-57ef63456ce0 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 852 time: 0.9521966
May 31 16:19:55.279045 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 56244) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:19:55.284933 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:19:55.306905 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:19:55.311360 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Usage tracker for resource:router and tenant:12203182731d4a61acb7fc5914aef425 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:19:55.318641 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:19:55.331708 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:19:55.354845 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-16623804', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-697'] for router, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:55.356078 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-16618684', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-16621667', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-16430734', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-672'] for router, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:55.383079 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:55.390205 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1128099061-network', 'tenant_id': '16e81170a75c4b11a58e6d70b30c98b7'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:19:55.399009 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:19:55.403719 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Usage tracker for resource:network and tenant:16e81170a75c4b11a58e6d70b30c98b7 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:19:55.407066 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:19:55.413157 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:19:55.468847 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Made reservation on behalf of 16e81170a75c4b11a58e6d70b30c98b7 for: {'network': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:19:55.472225 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-639279'] for network, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:55.499667 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:55.535310 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:19:55.548506 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Usage tracker for resource:security_group_rule and tenant:16e81170a75c4b11a58e6d70b30c98b7 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:19:55.554359 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:19:55.566517 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:19:55.662465 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:55.671373 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp87ca72be-1027-56d4-a8d3-ba9dae998815-be7d7603-734f-43bb-92a8-ed07a835aeb5', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d'}]}} from dv-cinder-793814-1-iscsi. {{(pid=91765) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 31 16:19:55.672357 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:55.676469 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:55.690697 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:19:55.737489 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2ddff6af-58b8-4216-b12c-394bda88aeb3,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:19:55.780229 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:19:55.829711 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 824}  {{(pid=91764) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 31 16:19:55.891471 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:55.892067 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.db.segments_db [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Added segment 5a3941ae-d5de-4802-8fd8-3da6c1932b05 of type vlan for network d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1
May 31 16:19:55.916135 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-aa1609a4-40c2-4ee1-bfca-eb3403798799 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357'] for subnet, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:55.920118 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.db_base_plugin_common [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Allocated IP 172.20.0.2 (be7d7603-734f-43bb-92a8-ed07a835aeb5/eb5363fe-ee39-4adc-b299-6098caad681d/84fd09f1-dd06-4f60-a27d-e40786f986b7) {{(pid=91765) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:19:55.947529 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:19:56.027168 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:56.073016 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732784079930'] for network, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:56.114542 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa1609a4-40c2-4ee1-bfca-eb3403798799 admin admin] Checking segment: {'id': '016e9daa-b906-4ec8-978d-cb58fbcd78da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:19:56.115065 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa1609a4-40c2-4ee1-bfca-eb3403798799 admin admin] Network hostable DHCP agents. Network: 1097eeec-06a4-406d-ab4a-02e0123072d2, hostable agents: ['5c9859e8-5965-4c86-8b2b-8fab235cbf66'], hosted agents: [] {{(pid=91764) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 31 16:19:56.126107 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:56.130789 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16621638', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16623758', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-722'] for router, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:56.169705 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Notify callbacks [] for port, precommit_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:56.182672 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Transition to ACTIVE for port object 84fd09f1-dd06-4f60-a27d-e40786f986b7 will not be triggered until provisioned by entity L2. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:19:56.205989 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Transition to ACTIVE for port object 84fd09f1-dd06-4f60-a27d-e40786f986b7 will not be triggered until provisioned by entity DHCP. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:19:56.216702 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:56.222318 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 815}  {{(pid=91764) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 31 16:19:56.231675 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:19:56.233940 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:56.234711 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.db.segments_db [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Added segment 5d13bef9-5e34-4b31-8817-4dba0534b3a7 of type vlan for network c99513ad-3df3-429c-a5ba-a2334e5c92fc
May 31 16:19:56.246008 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366'] for network, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:56.254559 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:19:56.255555 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:56.260447 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa1609a4-40c2-4ee1-bfca-eb3403798799 admin admin] Pushing event updated for resources: {'Subnet': ['ID=68c4d303-4299-4977-888e-57c80b8530cc,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:19:56.272713 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-aa1609a4-40c2-4ee1-bfca-eb3403798799 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.325s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:19:56.279383 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.040s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:19:56.305794 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa1609a4-40c2-4ee1-bfca-eb3403798799 admin admin] Network 1097eeec-06a4-406d-ab4a-02e0123072d2 is scheduled to be hosted by DHCP agent 5c9859e8-5965-4c86-8b2b-8fab235cbf66 with binding_index 1 {{(pid=91764) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 31 16:19:56.330874 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732784079930'] for network, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:56.360280 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=165e01bc-53ca-416e-93c5-98db294169b6,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:19:56.367332 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:19:56.368921 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-aa1609a4-40c2-4ee1-bfca-eb3403798799 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793814-1-iscsi, 1097eeec-06a4-406d-ab4a-02e0123072d2) {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:19:56.371056 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-35d6416f-02ea-4894-829f-8baa502aeff6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.102s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:19:56.392363 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa1609a4-40c2-4ee1-bfca-eb3403798799 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:19:56.393048 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-aa1609a4-40c2-4ee1-bfca-eb3403798799 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:56.402304 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201  len: 892 time: 1.8428903
May 31 16:19:56.405791 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 56278) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:19:56.413320 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Pushing event updated for resources: {'Port': ['ID=84fd09f1-dd06-4f60-a27d-e40786f986b7,revision_number=1']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:19:56.422376 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-d7fcd0c1-f110-45a7-aa49-92aa8d7bcb7c admin admin] Request body: {'subnet': {'network_id': 'd89a2a7e-0a66-4cc2-94ab-1f50ba0056b1', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1748311148-subnet', 'tenant_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:19:56.437310 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1779cbc0-56e3-4431-9300-35512451a74c None None] Network 1097eeec-06a4-406d-ab4a-02e0123072d2 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:19:56.440158 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-d7fcd0c1-f110-45a7-aa49-92aa8d7bcb7c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:19:56.444981 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-d7fcd0c1-f110-45a7-aa49-92aa8d7bcb7c admin admin] Usage tracker for resource:subnet and tenant:1739d3c0e2734c8a9af5c5291aac8e25 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:19:56.457585 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-d7fcd0c1-f110-45a7-aa49-92aa8d7bcb7c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:19:56.471141 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:56.472806 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:56.473970 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:56.476424 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:56.478419 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:56.480199 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:56.480345 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-d7fcd0c1-f110-45a7-aa49-92aa8d7bcb7c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:19:56.480845 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:56.481351 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:56.481935 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:56.483410 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:56.483906 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:56.485115 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Tracked resource versions report:
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]: pushed versions:
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]: {   'AddressGroup': {'1.2'},
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:     'ConntrackHelper': {'1.0'},
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:     'Log': {'1.0'},
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:     'Network': {'1.1'},
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:     'Port': {'1.7'},
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:     'PortForwarding': {'1.2'},
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:     'QosPolicy': {'1.8'},
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:     'SecurityGroup': {'1.4'},
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:     'SecurityGroupRule': {'1.2'},
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:     'SubPort': {'1.0'},
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:     'Subnet': {'1.1'},
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:     'Trunk': {'1.1'}}
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]: consumer versions:
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]: {   DHCP agent@dv-cinder-793814-1-iscsi: {},
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:     HyperV agent@hv-cinder-79381: {},
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:     L3 agent@dv-cinder-793814-1-iscsi: {},
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:     Metadata agent@dv-cinder-793814-1-iscsi: {},
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:     Metering agent@dv-cinder-793814-1-iscsi: {},
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:     Open vSwitch agent@dv-cinder-793814-1-iscsi: {   'AddressGroup': '1.2',
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'ConntrackHelper': '1.0',
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'Log': '1.0',
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'Network': '1.1',
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'Port': '1.7',
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'PortForwarding': '1.2',
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'QosPolicy': '1.8',
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'SecurityGroup': '1.4',
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'SecurityGroupRule': '1.2',
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'SubPort': '1.0',
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'Subnet': '1.1',
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:                                                      'Trunk': '1.1'}}
May 31 16:19:56.487612 dv-cinder-793814-1-iscsi neutron-server[91765]:  {{(pid=91765) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 31 16:19:56.506495 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-aa1609a4-40c2-4ee1-bfca-eb3403798799 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 1.6622970
May 31 16:19:56.510830 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Pushing event updated for resources: {'Network': ['ID=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:19:56.516007 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:19:56.517167 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366'] for network, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:56.518536 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:19:56.519103 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:56.522641 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-68270979-bea9-4427-97af-7b9e3376b199 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:19:56.525728 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.285s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:19:56.593845 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Network d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 details requested by agent ovs-agent-dv-cinder-793814-1-iscsi with host dv-cinder-793814-1-iscsi {{(pid=91765) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 31 16:19:56.713782 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 56294) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:19:56.722612 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Network be7d7603-734f-43bb-92a8-ed07a835aeb5 is already hosted by enough agents. {{(pid=91765) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:19:56.774562 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 1.9649661
May 31 16:19:56.775265 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 56300) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:19:56.800254 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-45c57dad-5592-43b5-9cb4-8dac3c1409ef admin admin] Request body: {'subnet': {'network_id': 'c99513ad-3df3-429c-a5ba-a2334e5c92fc', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1128099061-subnet', 'tenant_id': '16e81170a75c4b11a58e6d70b30c98b7', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:19:56.825801 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-45c57dad-5592-43b5-9cb4-8dac3c1409ef admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:19:56.825801 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-45c57dad-5592-43b5-9cb4-8dac3c1409ef admin admin] Usage tracker for resource:subnet and tenant:16e81170a75c4b11a58e6d70b30c98b7 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:19:56.833600 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-45c57dad-5592-43b5-9cb4-8dac3c1409ef admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:19:56.845998 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-45c57dad-5592-43b5-9cb4-8dac3c1409ef admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:19:56.864236 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Pushing event updated for resources: {'Network': ['ID=c99513ad-3df3-429c-a5ba-a2334e5c92fc,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:19:56.876072 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.353s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:19:56.878285 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-45c57dad-5592-43b5-9cb4-8dac3c1409ef admin admin] Made reservation on behalf of 16e81170a75c4b11a58e6d70b30c98b7 for: {'subnet': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:19:56.886039 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-45c57dad-5592-43b5-9cb4-8dac3c1409ef admin admin] Notify callbacks [] for subnet, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:56.887012 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:56.892249 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Network c99513ad-3df3-429c-a5ba-a2334e5c92fc details requested by agent ovs-agent-dv-cinder-793814-1-iscsi with host dv-cinder-793814-1-iscsi {{(pid=91765) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 31 16:19:56.926178 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:56.938623 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.scheduler.base_scheduler [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Resources bound (agent type, host, resource id):  {{(pid=91765) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:19:56.960376 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Received port after_create {{(pid=91765) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:19:57.012441 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d7fcd0c1-f110-45a7-aa49-92aa8d7bcb7c admin admin] Made reservation on behalf of 1739d3c0e2734c8a9af5c5291aac8e25 for: {'subnet': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:19:57.017118 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d7fcd0c1-f110-45a7-aa49-92aa8d7bcb7c admin admin] Notify callbacks [] for subnet, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:57.179351 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e0a86f7-8b41-46ed-8e90-7c4c92590a20 None None] Network 1097eeec-06a4-406d-ab4a-02e0123072d2 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:19:57.291150 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-0de0dd6a-511e-45fa-9d71-497b26619d63 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:57.329515 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Attempting to bind port 84fd09f1-dd06-4f60-a27d-e40786f986b7 on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:19:57.329915 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Attempting to bind port 84fd09f1-dd06-4f60-a27d-e40786f986b7 by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '39cd3b8c-a501-4003-900e-4c3bab514801', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 806, 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5'}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:19:57.330309 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Attempting to bind port 84fd09f1-dd06-4f60-a27d-e40786f986b7 on network be7d7603-734f-43bb-92a8-ed07a835aeb5 {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:19:57.343059 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-0de0dd6a-511e-45fa-9d71-497b26619d63 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:19:57.347096 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-0de0dd6a-511e-45fa-9d71-497b26619d63 admin admin] Usage tracker for resource:security_group_rule and tenant:225fc26877bd45a5aaf98f1b87fcbbb5 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:19:57.348663 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 19, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:19:57.349044 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Checking segment: {'id': '39cd3b8c-a501-4003-900e-4c3bab514801', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 806, 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91765) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:19:57.349452 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:57.349891 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Bound using segment: {'id': '39cd3b8c-a501-4003-900e-4c3bab514801', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 806, 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5'} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:19:57.355180 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-0de0dd6a-511e-45fa-9d71-497b26619d63 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:19:57.357149 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Bound port: 84fd09f1-dd06-4f60-a27d-e40786f986b7, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '39cd3b8c-a501-4003-900e-4c3bab514801', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 806, 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5'}}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:19:57.357570 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:57.366739 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-0de0dd6a-511e-45fa-9d71-497b26619d63 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:19:57.367834 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Allocated IP 172.27.0.247 (00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c/96709d85-d0fe-4cf8-b232-eaf6b143ebe6/ec87a42d-446b-48d8-8654-589a5b1f5357) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:19:57.757595 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:57.878640 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-0de0dd6a-511e-45fa-9d71-497b26619d63 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:57.884617 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] For port 84fd09f1-dd06-4f60-a27d-e40786f986b7, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91765) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:19:57.892235 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] For port 84fd09f1-dd06-4f60-a27d-e40786f986b7, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=84fd09f1-dd06-4f60-a27d-e40786f986b7,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:19:57.900383 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-0de0dd6a-511e-45fa-9d71-497b26619d63 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:57.900766 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:57.906616 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:19:57.931908 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:19:57.942794 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:57.974102 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-bac70491-ad97-4f93-87ce-145cd42bd3e0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.012s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:19:57.994307 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0de0dd6a-511e-45fa-9d71-497b26619d63 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=01440b0f-cc25-46f9-bb8d-90eec3cba2c0,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:19:57.999785 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-0de0dd6a-511e-45fa-9d71-497b26619d63 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:19:58.012485 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-0de0dd6a-511e-45fa-9d71-497b26619d63 admin admin] Synchronizing usage tracker for tenant:62d3939038d943a283e167c51790b574 on resource:security_group {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:19:58.040401 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Pushing event updated for resources: {'Port': ['ID=84fd09f1-dd06-4f60-a27d-e40786f986b7,revision_number=2']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:19:58.044187 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:19:58.109804 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:19:58.112476 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:19:58.124603 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:19:58.128986 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-0de0dd6a-511e-45fa-9d71-497b26619d63 admin admin] Unset dirty status for tenant:62d3939038d943a283e167c51790b574 on resource:security_group {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:19:58.130825 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-0de0dd6a-511e-45fa-9d71-497b26619d63 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=225fc26877bd45a5aaf98f1b87fcbbb5&name=default HTTP/1.1" status: 200  len: 2975 time: 1.4152422
May 31 16:19:58.134554 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 56364) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:19:58.147071 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-45c57dad-5592-43b5-9cb4-8dac3c1409ef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357'] for subnet, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:58.161580 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:19:58.172310 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:19:58.259095 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 56376) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:19:58.259095 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c57dad-5592-43b5-9cb4-8dac3c1409ef admin admin] Pushing event updated for resources: {'Subnet': ['ID=d6d29986-6b64-4e75-9065-dbd87b0b7ea3,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:19:58.270161 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-45c57dad-5592-43b5-9cb4-8dac3c1409ef admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:19:58.274259 dv-cinder-793814-1-iscsi neutron-server[91764]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
May 31 16:19:58.363792 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Pushing event updated for resources: {'Port': ['ID=ec87a42d-446b-48d8-8654-589a5b1f5357,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:19:58.465489 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.491s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:19:58.546266 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-63f2720a-dc48-439e-b098-3b9b361825cd tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:19:58.559092 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-63f2720a-dc48-439e-b098-3b9b361825cd tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/networks?id=1097eeec-06a4-406d-ab4a-02e0123072d2 HTTP/1.1" status: 200  len: 814 time: 0.2974706
May 31 16:19:58.639665 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-f3cff8bd-785e-4089-ba86-1ad02a4282c8 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/quotas/0eb6e65b3f844417816fb1e5c88a8004 HTTP/1.1" status: 200  len: 375 time: 0.0796559
May 31 16:19:58.639851 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 84fd09f1-dd06-4f60-a27d-e40786f986b7 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:19:58.712528 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c9609d99-340c-40c1-aee3-230dcfa41f10 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:58.716423 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-4b9132c0-b121-4a14-a97e-f116b7e922cf tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=0eb6e65b3f844417816fb1e5c88a8004&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0650952
May 31 16:19:58.757582 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45c57dad-5592-43b5-9cb4-8dac3c1409ef admin admin] Checking segment: {'id': '5d13bef9-5e34-4b31-8817-4dba0534b3a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': 'c99513ad-3df3-429c-a5ba-a2334e5c92fc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:19:58.758132 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45c57dad-5592-43b5-9cb4-8dac3c1409ef admin admin] Network hostable DHCP agents. Network: c99513ad-3df3-429c-a5ba-a2334e5c92fc, hostable agents: ['5c9859e8-5965-4c86-8b2b-8fab235cbf66'], hosted agents: [] {{(pid=91764) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 31 16:19:58.798850 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port 84fd09f1-dd06-4f60-a27d-e40786f986b7 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:19:58.824576 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c9609d99-340c-40c1-aee3-230dcfa41f10 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:58.850095 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d7fcd0c1-f110-45a7-aa49-92aa8d7bcb7c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357'] for subnet, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:58.860963 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-b94bc66b-8359-4cd6-957c-c38ad6bec1c7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:19:58.869821 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45c57dad-5592-43b5-9cb4-8dac3c1409ef admin admin] Network c99513ad-3df3-429c-a5ba-a2334e5c92fc is scheduled to be hosted by DHCP agent 5c9859e8-5965-4c86-8b2b-8fab235cbf66 with binding_index 1 {{(pid=91764) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 31 16:19:58.903793 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-45c57dad-5592-43b5-9cb4-8dac3c1409ef admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793814-1-iscsi, c99513ad-3df3-429c-a5ba-a2334e5c92fc) {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:19:58.908862 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-45c57dad-5592-43b5-9cb4-8dac3c1409ef admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:19:58.911175 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-45c57dad-5592-43b5-9cb4-8dac3c1409ef admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:58.919556 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:58.919794 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-08ee3e72-1363-478a-a865-10a32f8ce19a None None] Network c99513ad-3df3-429c-a5ba-a2334e5c92fc requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:19:58.964732 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c9609d99-340c-40c1-aee3-230dcfa41f10 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:58.969481 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-45c57dad-5592-43b5-9cb4-8dac3c1409ef admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 849 time: 2.1904936
May 31 16:19:58.973341 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c9609d99-340c-40c1-aee3-230dcfa41f10 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:58.975070 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-c9609d99-340c-40c1-aee3-230dcfa41f10 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/01440b0f-cc25-46f9-bb8d-90eec3cba2c0 HTTP/1.1" status: 204  len: 168 time: 0.8392940
May 31 16:19:58.977251 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:19:58.993403 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9609d99-340c-40c1-aee3-230dcfa41f10 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=01440b0f-cc25-46f9-bb8d-90eec3cba2c0,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:19:58.996233 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c9609d99-340c-40c1-aee3-230dcfa41f10 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:19:59.045845 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-6a9a0745-082f-4016-a546-57ce6007de0a service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=91764) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 31 16:19:59.047040 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-6a9a0745-082f-4016-a546-57ce6007de0a service neutron] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.1559155
May 31 16:19:59.130492 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7fcd0c1-f110-45a7-aa49-92aa8d7bcb7c admin admin] Pushing event updated for resources: {'Subnet': ['ID=b9c806fb-2a53-4445-8352-4336429eb043,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:19:59.186307 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 56422) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:19:59.257340 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d7fcd0c1-f110-45a7-aa49-92aa8d7bcb7c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.397s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:19:59.258345 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7fcd0c1-f110-45a7-aa49-92aa8d7bcb7c admin admin] Checking segment: {'id': '5a3941ae-d5de-4802-8fd8-3da6c1932b05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': 'd89a2a7e-0a66-4cc2-94ab-1f50ba0056b1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91763) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:19:59.258824 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7fcd0c1-f110-45a7-aa49-92aa8d7bcb7c admin admin] Network hostable DHCP agents. Network: d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1, hostable agents: ['5c9859e8-5965-4c86-8b2b-8fab235cbf66'], hosted agents: [] {{(pid=91763) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 31 16:19:59.391238 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e73f1fa-0544-4731-8759-4ff2cde28628 None None] Network c99513ad-3df3-429c-a5ba-a2334e5c92fc requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:19:59.413381 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b37b83e4-56be-48ec-80a8-c7b55467abee service neutron] 10.222.0.43 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3599181
May 31 16:19:59.421339 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7fcd0c1-f110-45a7-aa49-92aa8d7bcb7c admin admin] Network d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 is scheduled to be hosted by DHCP agent 5c9859e8-5965-4c86-8b2b-8fab235cbf66 with binding_index 1 {{(pid=91763) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 31 16:19:59.504095 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-d7fcd0c1-f110-45a7-aa49-92aa8d7bcb7c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793814-1-iscsi, d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1) {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:19:59.515421 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d7fcd0c1-f110-45a7-aa49-92aa8d7bcb7c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:19:59.516298 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d7fcd0c1-f110-45a7-aa49-92aa8d7bcb7c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:59.551816 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-d7fcd0c1-f110-45a7-aa49-92aa8d7bcb7c admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 856 time: 3.1340680
May 31 16:19:59.555591 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 56444) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:19:59.636743 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1748311148-router', 'tenant_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:19:59.646066 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:19:59.655299 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Usage tracker for resource:router and tenant:1739d3c0e2734c8a9af5c5291aac8e25 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:19:59.658791 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:19:59.665173 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:19:59.693362 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-16623804', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-697'] for router, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:59.695068 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-16618684', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-16621667', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-16430734', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-672'] for router, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:59.713701 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:59.780866 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-c6d21ed2-c0fa-4675-a649-f541841a344a service neutron] 10.222.0.43 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3550878
May 31 16:19:59.861725 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e9f257fb-4ae3-41c4-960c-a6bf47046772 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:19:59.867976 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d631f5b6-4ffe-41c3-8fea-2517c15d818b None None] Network d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:19:59.915584 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-e9f257fb-4ae3-41c4-960c-a6bf47046772 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:19:59.927724 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-e9f257fb-4ae3-41c4-960c-a6bf47046772 admin admin] Usage tracker for resource:security_group_rule and tenant:f83fd069f171470ab14d75fd078fc3dc is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:19:59.938453 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 56460) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:19:59.953141 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-e9f257fb-4ae3-41c4-960c-a6bf47046772 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:00.011600 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-e9f257fb-4ae3-41c4-960c-a6bf47046772 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:00.014399 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-9da07832-4383-44cb-a231-e62a0718cc7f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:00.051742 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-9da07832-4383-44cb-a231-e62a0718cc7f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:00.071067 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-9da07832-4383-44cb-a231-e62a0718cc7f admin admin] Usage tracker for resource:security_group_rule and tenant:3786abd897664d55a47f850445bcc972 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:00.071325 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-16623797', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16621573'] for router, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:00.077016 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-9da07832-4383-44cb-a231-e62a0718cc7f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:00.091320 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-9da07832-4383-44cb-a231-e62a0718cc7f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:00.208140 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ee183c7-c72d-4686-aa8e-ff0719bd2690 None None] Network be7d7603-734f-43bb-92a8-ed07a835aeb5 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:20:00.354843 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16621638', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16623758', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-722'] for router, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:00.390041 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e9f257fb-4ae3-41c4-960c-a6bf47046772 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:00.433182 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8c72149f-3b00-4e94-aa9a-eb6ef98ca221 req-4d83f741-544e-46c4-abfe-6172f7a0e46f tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 210 time: 0.1520300
May 31 16:20:00.462068 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e9f257fb-4ae3-41c4-960c-a6bf47046772 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:00.526336 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-a44478e3-a5d0-411e-b18e-91294cdff4b5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:00.611219 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 56520) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:00.778096 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-216584c7-6d35-4374-b8bc-80be641c6148 None None] Network d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:20:00.832637 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-3b9b3660-2fa3-41dc-8875-233c4d854efe None None] Provisioning for port 84fd09f1-dd06-4f60-a27d-e40786f986b7 completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:20:00.952528 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-3b9b3660-2fa3-41dc-8875-233c4d854efe None None] Provisioning complete for port 84fd09f1-dd06-4f60-a27d-e40786f986b7 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:20:00.952924 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-3b9b3660-2fa3-41dc-8875-233c4d854efe None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:01.017995 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-395422a7-c513-4f8c-9c2b-6de44122bcd5 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:01.018903 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-395422a7-c513-4f8c-9c2b-6de44122bcd5 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Synchronizing usage tracker for tenant:16e81170a75c4b11a58e6d70b30c98b7 on resource:network {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:20:01.029736 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-9da07832-4383-44cb-a231-e62a0718cc7f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:01.044165 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9f257fb-4ae3-41c4-960c-a6bf47046772 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=62c07c6c-fd09-4aed-9af4-da6cf73d9117,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:01.048440 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-e9f257fb-4ae3-41c4-960c-a6bf47046772 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.524s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:01.049461 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-9da07832-4383-44cb-a231-e62a0718cc7f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:01.055420 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-e9f257fb-4ae3-41c4-960c-a6bf47046772 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=f83fd069f171470ab14d75fd078fc3dc&name=default HTTP/1.1" status: 200  len: 2975 time: 1.8646839
May 31 16:20:01.061492 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 56548) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:01.064067 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:01.075153 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-395422a7-c513-4f8c-9c2b-6de44122bcd5 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Unset dirty status for tenant:16e81170a75c4b11a58e6d70b30c98b7 on resource:network {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:20:01.076520 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-395422a7-c513-4f8c-9c2b-6de44122bcd5 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/networks?id=c99513ad-3df3-429c-a5ba-a2334e5c92fc HTTP/1.1" status: 200  len: 812 time: 0.4154191
May 31 16:20:01.143446 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-9da07832-4383-44cb-a231-e62a0718cc7f admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=3786abd897664d55a47f850445bcc972&name=default HTTP/1.1" status: 200  len: 2975 time: 1.1995256
May 31 16:20:01.150031 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 56554) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:01.161760 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-31325856-4940-4cbb-92f1-21234a065e35 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/quotas/16e81170a75c4b11a58e6d70b30c98b7 HTTP/1.1" status: 200  len: 375 time: 0.0605977
May 31 16:20:01.185687 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9da07832-4383-44cb-a231-e62a0718cc7f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=396e99f5-3318-4010-b40b-d2812323120f,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:01.188826 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-9da07832-4383-44cb-a231-e62a0718cc7f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:01.258068 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-c65828f7-0e17-4d93-af80-32e31add1904 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=16e81170a75c4b11a58e6d70b30c98b7&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0762577
May 31 16:20:01.295857 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-73a52256-1224-473e-b9f7-6e957f6ffb54 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:01.348188 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Router 8471b167-8540-4806-9932-e05fcb75a12b is scheduled to L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e with binding_index 1 {{(pid=91763) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 31 16:20:01.356458 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b0361f64-dc0c-4fd7-b636-7172b37f0c27 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:01.391063 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-73a52256-1224-473e-b9f7-6e957f6ffb54 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:01.449610 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b0361f64-dc0c-4fd7-b636-7172b37f0c27 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:01.482085 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-3b9b3660-2fa3-41dc-8875-233c4d854efe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:01.613283 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-68aac3a0-9dbc-400b-b0e4-55a2f6f5ac94 req-616239c4-cc0a-45b0-94ac-c83f39947233 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 210 time: 0.0941763
May 31 16:20:01.638883 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-73a52256-1224-473e-b9f7-6e957f6ffb54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:01.658933 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:01.686709 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a52256-1224-473e-b9f7-6e957f6ffb54 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=62c07c6c-fd09-4aed-9af4-da6cf73d9117,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:01.696835 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-73a52256-1224-473e-b9f7-6e957f6ffb54 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:01.700678 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-73a52256-1224-473e-b9f7-6e957f6ffb54 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/62c07c6c-fd09-4aed-9af4-da6cf73d9117 HTTP/1.1" status: 204  len: 168 time: 0.6224780
May 31 16:20:01.703110 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b0361f64-dc0c-4fd7-b636-7172b37f0c27 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:01.704540 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-73a52256-1224-473e-b9f7-6e957f6ffb54 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:01.712287 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b0361f64-dc0c-4fd7-b636-7172b37f0c27 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:01.714221 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-b0361f64-dc0c-4fd7-b636-7172b37f0c27 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/396e99f5-3318-4010-b40b-d2812323120f HTTP/1.1" status: 204  len: 168 time: 0.5601211
May 31 16:20:01.714891 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:01.753477 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-3b9b3660-2fa3-41dc-8875-233c4d854efe None None] For port 84fd09f1-dd06-4f60-a27d-e40786f986b7, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=84fd09f1-dd06-4f60-a27d-e40786f986b7,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:20:01.768971 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0361f64-dc0c-4fd7-b636-7172b37f0c27 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=396e99f5-3318-4010-b40b-d2812323120f,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:01.773117 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-b0361f64-dc0c-4fd7-b636-7172b37f0c27 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:01.775950 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:01.783913 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-3b9b3660-2fa3-41dc-8875-233c4d854efe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:01.798461 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:01.828915 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:01.923235 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b9b3660-2fa3-41dc-8875-233c4d854efe None None] Pushing event updated for resources: {'Port': ['ID=84fd09f1-dd06-4f60-a27d-e40786f986b7,revision_number=3']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:01.928978 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-3b9b3660-2fa3-41dc-8875-233c4d854efe None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:01.962974 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-b7224c32-e2f6-420b-9586-997de3a460b6 None None] Provisioning complete for port 84fd09f1-dd06-4f60-a27d-e40786f986b7 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:20:01.963599 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-b7224c32-e2f6-420b-9586-997de3a460b6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:02.171951 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:20:02.185222 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] Sync routers for ids ['8471b167-8540-4806-9932-e05fcb75a12b'] in dv-cinder-793814-1-iscsi {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:20:02.205420 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] Routers {'8471b167-8540-4806-9932-e05fcb75a12b'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:20:02.208029 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f142701ff70>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:19:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['8471b167-8540-4806-9932-e05fcb75a12b'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:20:02.213035 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Notify callbacks [] for router, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:02.214289 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201  len: 928 time: 6.9338644
May 31 16:20:02.218765 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 56608) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:02.249949 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Allocated IP 172.27.0.92 (00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c/96709d85-d0fe-4cf8-b232-eaf6b143ebe6/a2424563-d6d6-443a-a1ac-cb2782c1c228) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:20:02.508842 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:02.574709 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:02.580875 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:02.595369 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 84fd09f1-dd06-4f60-a27d-e40786f986b7 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:20:02.759137 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Pushing event updated for resources: {'Port': ['ID=a2424563-d6d6-443a-a1ac-cb2782c1c228,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:02.765630 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:02.767960 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:20:02.770341 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:20:02.774692 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:20:02.785322 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-6d883dc5-1061-4808-bafc-8096e66e05f4 service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=91764) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 31 16:20:02.786481 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-6d883dc5-1061-4808-bafc-8096e66e05f4 service neutron] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 1.0417995
May 31 16:20:02.845451 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 84fd09f1-dd06-4f60-a27d-e40786f986b7 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:20:02.846271 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:02.907467 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] Set router 8471b167-8540-4806-9932-e05fcb75a12b gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:20:03.123688 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 56628) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:03.298203 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ad5e8eb2-ec2e-4574-a000-b6d9555d5fa6 req-8a4c7517-ab04-4ddf-97ed-7c1e28c81e42 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 210 time: 0.2941256
May 31 16:20:03.519519 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f142701ff70>, [{'id': '8471b167-8540-4806-9932-e05fcb75a12b', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:55Z', 'updated_at': '2021-05-31T16:19:58Z', 'revision_number': 3, 'project_id': '12203182731d4a61acb7fc5914aef425', 'gw_port': {'id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:83:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:19:56Z', 'updated_at': '2021-05-31T16:19:57Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:20:03.525687 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] Checking router: 8471b167-8540-4806-9932-e05fcb75a12b for host: dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:20:03.526545 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] Updating router 8471b167-8540-4806-9932-e05fcb75a12b port ec87a42d-446b-48d8-8654-589a5b1f5357 binding host dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 31 16:20:03.579228 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-c53ba19f-004d-4a5d-b00e-21a7d358889c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:03.596116 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:03.625880 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-c53ba19f-004d-4a5d-b00e-21a7d358889c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:03.660048 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-c53ba19f-004d-4a5d-b00e-21a7d358889c admin admin] Usage tracker for resource:security_group_rule and tenant:dd805eaf82e749678cbebb32fbefd89f is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:03.680506 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-c53ba19f-004d-4a5d-b00e-21a7d358889c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:03.685327 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:03.826759 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-c53ba19f-004d-4a5d-b00e-21a7d358889c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:03.922430 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-baa40b1c-1699-4380-b777-9681ebb45a04 service neutron] 10.222.0.43 "GET /v2.0/networks/c99513ad-3df3-429c-a5ba-a2334e5c92fc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.9614992
May 31 16:20:04.086971 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] Notify callbacks [] for port, precommit_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:04.118433 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.provisioning_blocks [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] Transition to ACTIVE for port object ec87a42d-446b-48d8-8654-589a5b1f5357 will not be triggered until provisioned by entity L2. {{(pid=91766) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:20:04.141644 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:04.146365 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-4d2a23bd-8f28-4a4d-a143-3c2bfe4162ea None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:04.228974 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-fcd2815a-eecd-4342-8d96-e3de85b7ec52 service neutron] 10.222.0.43 "GET /v2.0/networks/c99513ad-3df3-429c-a5ba-a2334e5c92fc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2971015
May 31 16:20:04.300874 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] Attempting to bind port ec87a42d-446b-48d8-8654-589a5b1f5357 on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:20:04.301243 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] Attempting to bind port ec87a42d-446b-48d8-8654-589a5b1f5357 by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}] {{(pid=91766) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:20:04.301625 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] Attempting to bind port ec87a42d-446b-48d8-8654-589a5b1f5357 on network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:20:04.323184 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 19, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:20:04.323551 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] Checking segment: {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91766) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:20:04.323946 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:04.324329 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] Bound using segment: {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'} {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:20:04.325078 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] Bound port: ec87a42d-446b-48d8-8654-589a5b1f5357, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}}] {{(pid=91766) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:20:04.325455 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:04.420360 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:04.441974 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ae1ff44-3b31-4294-a63d-12f5399e3d92 None None] Pushing event updated for resources: {'Port': ['ID=ec87a42d-446b-48d8-8654-589a5b1f5357,revision_number=2']} {{(pid=91766) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:04.478883 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ae1ff44-3b31-4294-a63d-12f5399e3d92 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:04.479221 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ae1ff44-3b31-4294-a63d-12f5399e3d92 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:04.479547 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ae1ff44-3b31-4294-a63d-12f5399e3d92 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:04.479866 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ae1ff44-3b31-4294-a63d-12f5399e3d92 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:04.480183 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ae1ff44-3b31-4294-a63d-12f5399e3d92 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:04.480495 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ae1ff44-3b31-4294-a63d-12f5399e3d92 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:04.480805 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ae1ff44-3b31-4294-a63d-12f5399e3d92 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:04.481293 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ae1ff44-3b31-4294-a63d-12f5399e3d92 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:04.485634 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ae1ff44-3b31-4294-a63d-12f5399e3d92 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:04.486120 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ae1ff44-3b31-4294-a63d-12f5399e3d92 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:04.486725 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ae1ff44-3b31-4294-a63d-12f5399e3d92 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:04.487196 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ae1ff44-3b31-4294-a63d-12f5399e3d92 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9ae1ff44-3b31-4294-a63d-12f5399e3d92 None None] Tracked resource versions report:
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]: pushed versions:
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]: {   'AddressGroup': {'1.2'},
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:     'ConntrackHelper': {'1.0'},
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:     'Log': {'1.0'},
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:     'Network': {'1.1'},
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:     'Port': {'1.7'},
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:     'PortForwarding': {'1.2'},
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:     'QosPolicy': {'1.8'},
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:     'SecurityGroup': {'1.4'},
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:     'SecurityGroupRule': {'1.2'},
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:     'SubPort': {'1.0'},
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:     'Subnet': {'1.1'},
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:     'Trunk': {'1.1'}}
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]: consumer versions:
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]: {   DHCP agent@dv-cinder-793814-1-iscsi: {},
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:     HyperV agent@hv-cinder-79381: {},
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:     L3 agent@dv-cinder-793814-1-iscsi: {},
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:     Metadata agent@dv-cinder-793814-1-iscsi: {},
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:     Metering agent@dv-cinder-793814-1-iscsi: {},
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:     Open vSwitch agent@dv-cinder-793814-1-iscsi: {   'AddressGroup': '1.2',
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'ConntrackHelper': '1.0',
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'Log': '1.0',
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'Network': '1.1',
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'Port': '1.7',
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'PortForwarding': '1.2',
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'QosPolicy': '1.8',
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'SecurityGroup': '1.4',
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'SecurityGroupRule': '1.2',
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'SubPort': '1.0',
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'Subnet': '1.1',
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:                                                      'Trunk': '1.1'}}
May 31 16:20:04.488706 dv-cinder-793814-1-iscsi neutron-server[91766]:  {{(pid=91766) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 31 16:20:04.498193 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-9ae1ff44-3b31-4294-a63d-12f5399e3d92 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.351s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:04.549435 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-c53ba19f-004d-4a5d-b00e-21a7d358889c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:04.566309 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.db [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] For port ec87a42d-446b-48d8-8654-589a5b1f5357, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91766) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:20:04.570630 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.db [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] For port ec87a42d-446b-48d8-8654-589a5b1f5357, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=ec87a42d-446b-48d8-8654-589a5b1f5357,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91766) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:20:04.572309 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-c53ba19f-004d-4a5d-b00e-21a7d358889c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:04.577019 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:04.582998 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:04.661142 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:04.682386 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] Routers {'8471b167-8540-4806-9932-e05fcb75a12b'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:20:04.683383 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f142701ff70>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:19:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['8471b167-8540-4806-9932-e05fcb75a12b'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:20:04.684663 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-c53ba19f-004d-4a5d-b00e-21a7d358889c admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=dd805eaf82e749678cbebb32fbefd89f&name=default HTTP/1.1" status: 200  len: 2975 time: 1.5593348
May 31 16:20:04.688921 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 56694) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:04.705414 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-16623797', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16621573'] for router, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:04.776681 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ae1ff44-3b31-4294-a63d-12f5399e3d92 None None] Pushing event updated for resources: {'Port': ['ID=ec87a42d-446b-48d8-8654-589a5b1f5357,revision_number=3']} {{(pid=91766) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:04.780824 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-9ae1ff44-3b31-4294-a63d-12f5399e3d92 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:04.839708 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0b6157e4-92ac-49eb-91f1-b4f9ad9f0682 req-07444f67-b45b-456b-ba52-671add8fd673 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 210 time: 0.2326548
May 31 16:20:04.876707 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f92719c7-49d1-40c1-850e-b027ab34667d req-02a2bb40-a2f9-4c0a-ae08-5218ceb792bd tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 210 time: 0.1955163
May 31 16:20:04.915664 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c53ba19f-004d-4a5d-b00e-21a7d358889c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=339c2aa3-b626-4508-8c7e-fd5aa004695e,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:04.919079 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-c53ba19f-004d-4a5d-b00e-21a7d358889c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.258s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:05.009939 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-c3b93e30-c96e-4fdf-9e48-28043c3276fc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:05.013815 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] Set router 8471b167-8540-4806-9932-e05fcb75a12b gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:20:05.140954 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-30bf31ef-0778-44ad-bbb6-0b82c635b781 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:05.218376 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Router d7d26526-a6db-4e30-b1f1-233672c995e8 is scheduled to L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e with binding_index 1 {{(pid=91763) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 31 16:20:05.276538 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-30bf31ef-0778-44ad-bbb6-0b82c635b781 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:05.333490 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Allocated IP 172.20.0.1 (be7d7603-734f-43bb-92a8-ed07a835aeb5/eb5363fe-ee39-4adc-b299-6098caad681d/db126eb4-e252-4765-86f1-09d3f20549df) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:20:05.396472 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f142701ff70>, [{'id': '8471b167-8540-4806-9932-e05fcb75a12b', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:55Z', 'updated_at': '2021-05-31T16:19:58Z', 'revision_number': 3, 'project_id': '12203182731d4a61acb7fc5914aef425', 'gw_port': {'id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:83:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:19:56Z', 'updated_at': '2021-05-31T16:20:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:20:05.402181 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ac20bd6-f7b8-4d07-8faf-6d086739bda9 None None] The sync data for ids ['8471b167-8540-4806-9932-e05fcb75a12b'] in dv-cinder-793814-1-iscsi is: [{'id': '8471b167-8540-4806-9932-e05fcb75a12b', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:55Z', 'updated_at': '2021-05-31T16:19:58Z', 'revision_number': 3, 'project_id': '12203182731d4a61acb7fc5914aef425', 'gw_port': {'id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:83:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:19:56Z', 'updated_at': '2021-05-31T16:20:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}] {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:20:05.544135 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-30bf31ef-0778-44ad-bbb6-0b82c635b781 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:05.552067 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:20:05.562456 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:05.562637 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] Sync routers for ids ['d7d26526-a6db-4e30-b1f1-233672c995e8'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:20:05.582335 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] Routers {'d7d26526-a6db-4e30-b1f1-233672c995e8'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:20:05.585397 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f14270d0fa0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:19:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['d7d26526-a6db-4e30-b1f1-233672c995e8'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:20:05.587349 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30bf31ef-0778-44ad-bbb6-0b82c635b781 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=339c2aa3-b626-4508-8c7e-fd5aa004695e,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:05.598825 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Notify callbacks [] for router, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:05.603155 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201  len: 930 time: 6.0437493
May 31 16:20:05.603446 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 56734) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:05.614913 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-30bf31ef-0778-44ad-bbb6-0b82c635b781 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:05.643139 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-30bf31ef-0778-44ad-bbb6-0b82c635b781 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:05.647624 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-30bf31ef-0778-44ad-bbb6-0b82c635b781 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/339c2aa3-b626-4508-8c7e-fd5aa004695e HTTP/1.1" status: 204  len: 168 time: 0.9414194
May 31 16:20:05.681128 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:05.713975 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.provisioning_blocks [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Transition to ACTIVE for port object db126eb4-e252-4765-86f1-09d3f20549df will not be triggered until provisioned by entity DHCP. {{(pid=91764) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:20:05.765091 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:05.772478 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-d03212b1-daab-43c7-81a1-e21dd7ca1580 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:05.991520 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Network be7d7603-734f-43bb-92a8-ed07a835aeb5 is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:20:05.994929 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:20:06.021288 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:20:06.024939 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-16627828'] for router_interface, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:06.244987 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] Set router d7d26526-a6db-4e30-b1f1-233672c995e8 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:20:06.536482 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 56772) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:06.615951 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e1c35139-fce0-4a2a-adad-225ba846c29e admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:06.682453 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device ec87a42d-446b-48d8-8654-589a5b1f5357 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:20:06.685210 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.63', 64828) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:06.749340 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Pushing event updated for resources: {'Port': ['ID=db126eb4-e252-4765-86f1-09d3f20549df,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:06.760817 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.988s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:06.908969 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-87035ce2-f19f-4953-b39c-6b39765e1fb0 None None] Provisioning for port db126eb4-e252-4765-86f1-09d3f20549df completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:20:06.909109 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c85c2ac6-ad92-4328-bdc1-aa8a8f76075f req-41259c71-5934-4929-bf49-26cb36d86178 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 210 time: 0.2771983
May 31 16:20:06.933967 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-87035ce2-f19f-4953-b39c-6b39765e1fb0 None None] Provisioning complete for port db126eb4-e252-4765-86f1-09d3f20549df triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:20:06.934399 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-87035ce2-f19f-4953-b39c-6b39765e1fb0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:06.937183 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-e1c35139-fce0-4a2a-adad-225ba846c29e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:06.967923 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-e1c35139-fce0-4a2a-adad-225ba846c29e admin admin] Usage tracker for resource:security_group_rule and tenant:29091f8661a14537b387e412ec120c91 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:06.993832 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-e1c35139-fce0-4a2a-adad-225ba846c29e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:07.025714 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-e1c35139-fce0-4a2a-adad-225ba846c29e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:07.081314 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-87035ce2-f19f-4953-b39c-6b39765e1fb0 None None] Port db126eb4-e252-4765-86f1-09d3f20549df cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:20:07.237906 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port ec87a42d-446b-48d8-8654-589a5b1f5357 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:20:07.248392 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port ec87a42d-446b-48d8-8654-589a5b1f5357 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:20:07.249459 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:07.440888 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:07.463284 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port ec87a42d-446b-48d8-8654-589a5b1f5357, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=ec87a42d-446b-48d8-8654-589a5b1f5357,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:20:07.477587 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:07.485335 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9b5d7fbf-78d5-446e-87ca-de2e49e1b416 req-6c8f5b7c-60c4-4b7e-a34c-fbdc63337beb tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 210 time: 0.8567321
May 31 16:20:07.490559 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-121c0747-1bc7-4709-ae9f-2553f209d614 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:07.552037 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.63', 64833) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:07.629718 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:07.668774 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f14270d0fa0>, [{'id': 'd7d26526-a6db-4e30-b1f1-233672c995e8', 'name': 'tempest-ServerRescueNegativeTestJSON-1748311148-router', 'tenant_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.92'}], 'enable_snat': True}, 'gw_port_id': 'a2424563-d6d6-443a-a1ac-cb2782c1c228', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:59Z', 'updated_at': '2021-05-31T16:20:03Z', 'revision_number': 3, 'project_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'gw_port': {'id': 'a2424563-d6d6-443a-a1ac-cb2782c1c228', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:fe:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd7d26526-a6db-4e30-b1f1-233672c995e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.92', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:01Z', 'updated_at': '2021-05-31T16:20:02Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:20:07.698062 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] Checking router: d7d26526-a6db-4e30-b1f1-233672c995e8 for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:20:07.698424 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] Updating router d7d26526-a6db-4e30-b1f1-233672c995e8 port a2424563-d6d6-443a-a1ac-cb2782c1c228 binding host dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 31 16:20:07.723472 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 56824) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:07.734040 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e1c35139-fce0-4a2a-adad-225ba846c29e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:07.802848 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=ec87a42d-446b-48d8-8654-589a5b1f5357,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:07.811282 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.320s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:07.943148 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:07.962347 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:08.105992 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-ee6f6af1-8f66-456d-b86b-7fce2b55393a tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:08.107903 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-ee6f6af1-8f66-456d-b86b-7fce2b55393a tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.63 "GET /v2.0/networks?id=c99513ad-3df3-429c-a5ba-a2334e5c92fc HTTP/1.1" status: 200  len: 812 time: 0.5472238
May 31 16:20:08.112470 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e1c35139-fce0-4a2a-adad-225ba846c29e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:08.255370 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:08.273641 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-253cbbd1-4113-499a-876d-665010b3bb21 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Request body: {'port': {'device_id': '1132cf94-cfb6-4b32-ae8b-ef0151475c72', 'network_id': 'c99513ad-3df3-429c-a5ba-a2334e5c92fc', 'admin_state_up': True, 'tenant_id': '16e81170a75c4b11a58e6d70b30c98b7'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:20:08.327744 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-c53ba19f-004d-4a5d-b00e-21a7d358889c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:08.342898 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-e1c35139-fce0-4a2a-adad-225ba846c29e admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=29091f8661a14537b387e412ec120c91&name=default HTTP/1.1" status: 200  len: 2975 time: 1.8049634
May 31 16:20:08.356380 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-1143ba40-445f-4187-83b7-8b1dc306a850 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:08.388845 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 56860) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:08.417276 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1c35139-fce0-4a2a-adad-225ba846c29e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c98f8ed-a737-43e8-b7ac-57457a9390a6,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:08.422966 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e1c35139-fce0-4a2a-adad-225ba846c29e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:08.444048 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-32d9faab-65f6-4113-bf49-398f72dfd494 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:08.444842 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-32d9faab-65f6-4113-bf49-398f72dfd494 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Synchronizing usage tracker for tenant:0eb6e65b3f844417816fb1e5c88a8004 on resource:network {{(pid=91763) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:20:08.580338 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Notify callbacks [] for port, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:08.593637 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-a3f787de-35ee-4e2b-a274-bb616b4c7741 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:08.612015 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:08.620758 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-32d9faab-65f6-4113-bf49-398f72dfd494 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Unset dirty status for tenant:0eb6e65b3f844417816fb1e5c88a8004 on resource:network {{(pid=91763) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:20:08.622239 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-32d9faab-65f6-4113-bf49-398f72dfd494 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.63 "GET /v2.0/networks?id=1097eeec-06a4-406d-ab4a-02e0123072d2 HTTP/1.1" status: 200  len: 814 time: 1.9356487
May 31 16:20:08.696517 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1bbf512c-a7e3-46f6-9e5f-05182b1e0d71 req-c0b772c5-8143-4e8f-bb3b-e9fbb2a1fbef tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 210 time: 0.3810744
May 31 16:20:08.744109 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b53bef65-9cf3-411b-92ee-892573689fb9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Request body: {'port': {'device_id': 'f08a2463-b6e4-494f-8f48-be855ffd203b', 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2', 'admin_state_up': True, 'tenant_id': '0eb6e65b3f844417816fb1e5c88a8004'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:20:08.766221 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-16310860', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-16627929'] for router_interface, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:08.781815 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device ec87a42d-446b-48d8-8654-589a5b1f5357 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:20:08.790167 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-a3f787de-35ee-4e2b-a274-bb616b4c7741 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:08.795031 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-a3f787de-35ee-4e2b-a274-bb616b4c7741 admin admin] Usage tracker for resource:security_group_rule and tenant:59d53cc65ec54012b62ec44f97a5f2f3 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:08.798286 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-a3f787de-35ee-4e2b-a274-bb616b4c7741 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:08.806824 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-a3f787de-35ee-4e2b-a274-bb616b4c7741 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:08.871112 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-90efb0c9-2b2e-494f-912b-4be61d1f5045 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:08.949189 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-a3f787de-35ee-4e2b-a274-bb616b4c7741 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:08.961121 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:09.100053 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port ec87a42d-446b-48d8-8654-589a5b1f5357 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:20:09.100478 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:09.185654 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-90efb0c9-2b2e-494f-912b-4be61d1f5045 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:09.236961 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Network be7d7603-734f-43bb-92a8-ed07a835aeb5 is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:20:09.238075 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-a3f787de-35ee-4e2b-a274-bb616b4c7741 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:09.271030 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:20:09.293054 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5d3788f6-0e63-4132-8ce7-d2f505ce27ec req-83037191-dfa6-4bf6-abaa-7b837a4e6c9c tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 210 time: 0.3395567
May 31 16:20:09.330281 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:09.646489 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Allocated IP 172.20.0.1 (d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1/b9c806fb-2a53-4445-8352-4336429eb043/13d2d45a-63a0-45f1-bfe6-b2f687e752e0) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:20:09.697792 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b53bef65-9cf3-411b-92ee-892573689fb9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:09.706516 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b53bef65-9cf3-411b-92ee-892573689fb9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Usage tracker for resource:port and tenant:0eb6e65b3f844417816fb1e5c88a8004 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:09.717971 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b53bef65-9cf3-411b-92ee-892573689fb9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:09.747015 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b53bef65-9cf3-411b-92ee-892573689fb9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:09.799327 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b53bef65-9cf3-411b-92ee-892573689fb9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Made reservation on behalf of 0eb6e65b3f844417816fb1e5c88a8004 for: {'port': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:20:09.818080 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b53bef65-9cf3-411b-92ee-892573689fb9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:09.831911 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] Notify callbacks [] for port, precommit_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:09.888773 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-8f382f6e-abd5-49ae-80ac-51d6efcc6c27 None None] Provisioning complete for port db126eb4-e252-4765-86f1-09d3f20549df triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:20:09.889475 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-8f382f6e-abd5-49ae-80ac-51d6efcc6c27 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:09.906082 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Pushing event updated for resources: {'Port': ['ID=db126eb4-e252-4765-86f1-09d3f20549df,revision_number=2']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:09.921891 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.961s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:09.961916 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.310s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:09.966766 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] Transition to ACTIVE for port object a2424563-d6d6-443a-a1ac-cb2782c1c228 will not be triggered until provisioned by entity L2. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:20:09.997243 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:10.026289 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-86e89553-23fb-4873-a73f-553d56e481a9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:10.046686 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-a3f787de-35ee-4e2b-a274-bb616b4c7741 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=59d53cc65ec54012b62ec44f97a5f2f3&name=default HTTP/1.1" status: 200  len: 2975 time: 2.3171642
May 31 16:20:10.058317 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 56900) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:10.059020 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3f787de-35ee-4e2b-a274-bb616b4c7741 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=097d28d9-e7e4-4c4e-863a-312c63ce542f,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:10.078419 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-a3f787de-35ee-4e2b-a274-bb616b4c7741 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:10.144275 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-8f382f6e-abd5-49ae-80ac-51d6efcc6c27 None None] Port db126eb4-e252-4765-86f1-09d3f20549df cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:20:10.201803 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] Attempting to bind port a2424563-d6d6-443a-a1ac-cb2782c1c228 on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:20:10.202799 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] Attempting to bind port a2424563-d6d6-443a-a1ac-cb2782c1c228 by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:20:10.203469 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] Attempting to bind port a2424563-d6d6-443a-a1ac-cb2782c1c228 on network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:20:10.211381 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12ca662b-0453-433c-a772-dfcc66e15ab6 None None] Pushing event updated for resources: {'Port': ['ID=a2424563-d6d6-443a-a1ac-cb2782c1c228,revision_number=2']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:10.216989 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-12ca662b-0453-433c-a772-dfcc66e15ab6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:10.218647 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 20, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:20:10.219332 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] Checking segment: {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91765) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:20:10.220874 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:10.221575 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] Bound using segment: {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:20:10.222454 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] Bound port: a2424563-d6d6-443a-a1ac-cb2782c1c228, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:20:10.223145 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:10.281630 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3f3edb53-d7ac-4c1e-a19d-5be6e3bdcbd7 req-cacd8cd3-06a1-44c1-9ab5-b030f9586aec tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 210 time: 0.2239952
May 31 16:20:10.299894 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Router 8471b167-8540-4806-9932-e05fcb75a12b has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91764) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:20:10.365338 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b53bef65-9cf3-411b-92ee-892573689fb9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Allocated IP 172.20.0.2 (1097eeec-06a4-406d-ab4a-02e0123072d2/68c4d303-4299-4977-888e-57c80b8530cc/5591c8db-5905-4285-84f7-5743de100fc2) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:20:10.380331 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] For port a2424563-d6d6-443a-a1ac-cb2782c1c228, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91765) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:20:10.386121 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] For port a2424563-d6d6-443a-a1ac-cb2782c1c228, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=a2424563-d6d6-443a-a1ac-cb2782c1c228,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91765) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:20:10.395308 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:10.424071 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-86e89553-23fb-4873-a73f-553d56e481a9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.002s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:10.578754 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-253cbbd1-4113-499a-876d-665010b3bb21 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:10.581566 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-45e73ec3-5e21-4089-81f4-1c3b2c42a411 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:10.622715 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-45e73ec3-5e21-4089-81f4-1c3b2c42a411 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:10.694368 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-253cbbd1-4113-499a-876d-665010b3bb21 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Usage tracker for resource:port and tenant:16e81170a75c4b11a58e6d70b30c98b7 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:10.704855 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-253cbbd1-4113-499a-876d-665010b3bb21 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:10.727244 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-253cbbd1-4113-499a-876d-665010b3bb21 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:10.741405 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b53bef65-9cf3-411b-92ee-892573689fb9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:10.816691 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] Routers {'d7d26526-a6db-4e30-b1f1-233672c995e8'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:20:10.816691 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f14270d0fa0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:20:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['d7d26526-a6db-4e30-b1f1-233672c995e8'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:20:10.848985 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c1e78df1-4289-48ba-a41f-395dc95f2f46 req-70e7ea2f-0c3a-4bc8-9b4d-a2cb787df355 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 210 time: 0.3073204
May 31 16:20:10.860339 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-253cbbd1-4113-499a-876d-665010b3bb21 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Made reservation on behalf of 16e81170a75c4b11a58e6d70b30c98b7 for: {'port': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:20:10.864605 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-253cbbd1-4113-499a-876d-665010b3bb21 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:10.921573 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b53bef65-9cf3-411b-92ee-892573689fb9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:10.931983 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-90efb0c9-2b2e-494f-912b-4be61d1f5045 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:10.957109 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-ee39012d-19ae-4abe-918f-f9d1e115e7be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:11.033246 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-45e73ec3-5e21-4089-81f4-1c3b2c42a411 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:11.062787 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-a3f787de-35ee-4e2b-a274-bb616b4c7741 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:11.076286 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12ca662b-0453-433c-a772-dfcc66e15ab6 None None] Pushing event updated for resources: {'Port': ['ID=a2424563-d6d6-443a-a1ac-cb2782c1c228,revision_number=3']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:11.078561 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b53bef65-9cf3-411b-92ee-892573689fb9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Network 1097eeec-06a4-406d-ab4a-02e0123072d2 is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:20:11.080413 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-90efb0c9-2b2e-494f-912b-4be61d1f5045 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:11.082463 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-90efb0c9-2b2e-494f-912b-4be61d1f5045 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/5c98f8ed-a737-43e8-b7ac-57457a9390a6 HTTP/1.1" status: 204  len: 168 time: 2.6666200
May 31 16:20:11.084107 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45e73ec3-5e21-4089-81f4-1c3b2c42a411 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=097d28d9-e7e4-4c4e-863a-312c63ce542f,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:11.091616 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b53bef65-9cf3-411b-92ee-892573689fb9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:20:11.094743 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b53bef65-9cf3-411b-92ee-892573689fb9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:20:11.107016 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b53bef65-9cf3-411b-92ee-892573689fb9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:11.108559 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b53bef65-9cf3-411b-92ee-892573689fb9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:11.112043 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-12ca662b-0453-433c-a772-dfcc66e15ab6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.689s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:11.120661 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-45e73ec3-5e21-4089-81f4-1c3b2c42a411 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:11.139569 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-45e73ec3-5e21-4089-81f4-1c3b2c42a411 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:11.144374 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-45e73ec3-5e21-4089-81f4-1c3b2c42a411 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/097d28d9-e7e4-4c4e-863a-312c63ce542f HTTP/1.1" status: 204  len: 168 time: 1.0602984
May 31 16:20:11.153464 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b53bef65-9cf3-411b-92ee-892573689fb9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.63 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.4584546
May 31 16:20:11.172503 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-fb6b86ad-c186-4b57-b36f-70e6725093c1 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=91763) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 31 16:20:11.173473 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-fb6b86ad-c186-4b57-b36f-70e6725093c1 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.63 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0061753
May 31 16:20:11.193005 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b53bef65-9cf3-411b-92ee-892573689fb9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Pushing event updated for resources: {'Port': ['ID=5591c8db-5905-4285-84f7-5743de100fc2,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:11.198264 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-b53bef65-9cf3-411b-92ee-892573689fb9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.241s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:11.204210 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.166s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:11.217547 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91764) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:20:11.224026 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90efb0c9-2b2e-494f-912b-4be61d1f5045 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c98f8ed-a737-43e8-b7ac-57457a9390a6,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:11.227060 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-90efb0c9-2b2e-494f-912b-4be61d1f5045 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:11.227599 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] Sync routers for ids ['8471b167-8540-4806-9932-e05fcb75a12b'] in dv-cinder-793814-1-iscsi {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:20:11.235245 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:11.241737 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] Routers {'8471b167-8540-4806-9932-e05fcb75a12b'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:20:11.242647 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f142701fc10>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:20:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['8471b167-8540-4806-9932-e05fcb75a12b'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:20:11.250709 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:11.262823 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] 10.222.0.43 "PUT /v2.0/routers/8471b167-8540-4806-9932-e05fcb75a12b/add_router_interface HTTP/1.1" status: 200  len: 503 time: 9.0389290
May 31 16:20:11.330226 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:11.335369 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:11.378890 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] Set router d7d26526-a6db-4e30-b1f1-233672c995e8 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:20:11.494848 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-253cbbd1-4113-499a-876d-665010b3bb21 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Allocated IP 172.20.0.11 (c99513ad-3df3-429c-a5ba-a2334e5c92fc/d6d29986-6b64-4e75-9065-dbd87b0b7ea3/0e5a85ae-aafa-4bae-adee-5fc58eaad298) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:20:11.556690 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Network d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:20:11.561386 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:20:11.564200 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:20:11.565152 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-16627828'] for router_interface, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:11.594028 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Pushing event updated for resources: {'Port': ['ID=13d2d45a-63a0-45f1-bfe6-b2f687e752e0,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:11.670183 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.333s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:11.933668 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f14270d0fa0>, [{'id': 'd7d26526-a6db-4e30-b1f1-233672c995e8', 'name': 'tempest-ServerRescueNegativeTestJSON-1748311148-router', 'tenant_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.92'}], 'enable_snat': True}, 'gw_port_id': 'a2424563-d6d6-443a-a1ac-cb2782c1c228', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:59Z', 'updated_at': '2021-05-31T16:20:03Z', 'revision_number': 3, 'project_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'gw_port': {'id': 'a2424563-d6d6-443a-a1ac-cb2782c1c228', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:fe:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd7d26526-a6db-4e30-b1f1-233672c995e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.92', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:01Z', 'updated_at': '2021-05-31T16:20:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:20:11.948010 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94e4e741-1600-4c8a-a667-82be34e742c8 None None] The sync data for ids ['d7d26526-a6db-4e30-b1f1-233672c995e8'] in dv-cinder-793814-1-iscsi is: [{'id': 'd7d26526-a6db-4e30-b1f1-233672c995e8', 'name': 'tempest-ServerRescueNegativeTestJSON-1748311148-router', 'tenant_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.92'}], 'enable_snat': True}, 'gw_port_id': 'a2424563-d6d6-443a-a1ac-cb2782c1c228', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:59Z', 'updated_at': '2021-05-31T16:20:03Z', 'revision_number': 3, 'project_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'gw_port': {'id': 'a2424563-d6d6-443a-a1ac-cb2782c1c228', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:fe:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd7d26526-a6db-4e30-b1f1-233672c995e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.92', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:01Z', 'updated_at': '2021-05-31T16:20:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:20:12.021040 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] Set router 8471b167-8540-4806-9932-e05fcb75a12b gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:20:12.092088 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:12.319854 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Request body: {'port': {'device_id': 'f08a2463-b6e4-494f-8f48-be855ffd203b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79381'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:20:12.562972 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-253cbbd1-4113-499a-876d-665010b3bb21 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:12.662057 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 56956) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:12.787858 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-253cbbd1-4113-499a-876d-665010b3bb21 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:12.851377 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:12.932305 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:12.970139 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f142701fc10>, [{'id': '8471b167-8540-4806-9932-e05fcb75a12b', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:55Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '12203182731d4a61acb7fc5914aef425', 'gw_port': {'id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:83:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:19:56Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': 'db126eb4-e252-4765-86f1-09d3f20549df', 'name': '', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'mac_address': 'fa:16:3e:63:bd:f1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:04Z', 'updated_at': '2021-05-31T16:20:08Z', 'revision_number': 2, 'project_id': '12203182731d4a61acb7fc5914aef425', 'subnets': [{'id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:20:12.983508 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] Checking router: 8471b167-8540-4806-9932-e05fcb75a12b for host: dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:20:12.984189 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] Updating router 8471b167-8540-4806-9932-e05fcb75a12b port db126eb4-e252-4765-86f1-09d3f20549df binding host dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 31 16:20:13.101698 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-253cbbd1-4113-499a-876d-665010b3bb21 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Network c99513ad-3df3-429c-a5ba-a2334e5c92fc is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:20:13.117959 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-253cbbd1-4113-499a-876d-665010b3bb21 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Pushing event updated for resources: {'Port': ['ID=0e5a85ae-aafa-4bae-adee-5fc58eaad298,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:13.120589 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-253cbbd1-4113-499a-876d-665010b3bb21 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:20:13.133291 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-61dacc3c-74f3-44c5-8e84-5c01c437ebaf admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:13.164703 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-253cbbd1-4113-499a-876d-665010b3bb21 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.232s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:13.168821 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-61dacc3c-74f3-44c5-8e84-5c01c437ebaf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:13.173017 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-61dacc3c-74f3-44c5-8e84-5c01c437ebaf admin admin] Usage tracker for resource:security_group_rule and tenant:f011071ed83e46f1b69a540c3daca061 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:13.199120 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-61dacc3c-74f3-44c5-8e84-5c01c437ebaf admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:13.225075 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:13.243921 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-61dacc3c-74f3-44c5-8e84-5c01c437ebaf admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:13.266606 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-253cbbd1-4113-499a-876d-665010b3bb21 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:20:13.290342 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-253cbbd1-4113-499a-876d-665010b3bb21 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:13.292745 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-253cbbd1-4113-499a-876d-665010b3bb21 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:13.406831 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-253cbbd1-4113-499a-876d-665010b3bb21 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.63 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 5.2213652
May 31 16:20:13.427572 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c25aaca4-774a-4f72-a592-1eeac3aa9039 req-37affb02-9fe5-47c7-8fd0-c3d54969a962 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:13.454789 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c25aaca4-774a-4f72-a592-1eeac3aa9039 req-37affb02-9fe5-47c7-8fd0-c3d54969a962 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 931 time: 1.4055629
May 31 16:20:13.466428 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Request body: {'port': {'device_id': '1132cf94-cfb6-4b32-ae8b-ef0151475c72', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79381'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:20:13.589495 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fe26ca6-f27a-4cf8-9813-eaf00421a15d req-5fbe56de-c270-4c4f-b5ee-a04658538e1c tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:13.590387 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-2fe26ca6-f27a-4cf8-9813-eaf00421a15d req-5fbe56de-c270-4c4f-b5ee-a04658538e1c tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Synchronizing usage tracker for tenant:16e81170a75c4b11a58e6d70b30c98b7 on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:20:13.637183 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.db.resource_extend [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] It took 0.16 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
May 31 16:20:13.733348 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:13.769886 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:13.787737 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-16310860', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-16627929'] for router_interface, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:13.831914 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:13.870481 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] Notify callbacks [] for port, precommit_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:13.904060 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.provisioning_blocks [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] Transition to ACTIVE for port object db126eb4-e252-4765-86f1-09d3f20549df will not be triggered until provisioned by entity L2. {{(pid=91766) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:20:13.920212 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:13.927463 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:13.995036 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c25aaca4-774a-4f72-a592-1eeac3aa9039 req-777996fc-9164-4008-91e2-c16297918662 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4449666
May 31 16:20:14.002203 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:14.020508 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-2fe26ca6-f27a-4cf8-9813-eaf00421a15d req-5fbe56de-c270-4c4f-b5ee-a04658538e1c tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Unset dirty status for tenant:16e81170a75c4b11a58e6d70b30c98b7 on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:20:14.028911 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2fe26ca6-f27a-4cf8-9813-eaf00421a15d req-5fbe56de-c270-4c4f-b5ee-a04658538e1c tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 932 time: 1.7089138
May 31 16:20:14.174896 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Pushing event updated for resources: {'Port': ['ID=13d2d45a-63a0-45f1-bfe6-b2f687e752e0,revision_number=2']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:14.193239 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-61dacc3c-74f3-44c5-8e84-5c01c437ebaf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:14.197388 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-2fe26ca6-f27a-4cf8-9813-eaf00421a15d req-cabeb33d-e54f-4d9a-a1e2-25f864e12109 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Synchronizing usage tracker for tenant:16e81170a75c4b11a58e6d70b30c98b7 on resource:security_group {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:20:14.233417 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.403s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:14.349547 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a8fc355-95eb-4e61-8c5d-7c1b25c8ee47 None None] Pushing event updated for resources: {'Port': ['ID=db126eb4-e252-4765-86f1-09d3f20549df,revision_number=3']} {{(pid=91766) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:14.357368 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-8a8fc355-95eb-4e61-8c5d-7c1b25c8ee47 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.430s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:14.418193 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-61dacc3c-74f3-44c5-8e84-5c01c437ebaf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:14.484396 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:14.611976 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] Attempting to bind port db126eb4-e252-4765-86f1-09d3f20549df on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:20:14.612356 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] Attempting to bind port db126eb4-e252-4765-86f1-09d3f20549df by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '39cd3b8c-a501-4003-900e-4c3bab514801', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 806, 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5'}] {{(pid=91766) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:20:14.615579 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] Attempting to bind port db126eb4-e252-4765-86f1-09d3f20549df on network be7d7603-734f-43bb-92a8-ed07a835aeb5 {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:20:14.618073 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Network d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:20:14.630481 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 20, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:20:14.630872 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] Checking segment: {'id': '39cd3b8c-a501-4003-900e-4c3bab514801', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 806, 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91766) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:20:14.631285 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:14.631691 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] Bound using segment: {'id': '39cd3b8c-a501-4003-900e-4c3bab514801', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 806, 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5'} {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:20:14.633066 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] Bound port: db126eb4-e252-4765-86f1-09d3f20549df, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '39cd3b8c-a501-4003-900e-4c3bab514801', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 806, 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5'}}] {{(pid=91766) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:20:14.633305 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:14.642931 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:20:14.659147 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61dacc3c-74f3-44c5-8e84-5c01c437ebaf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9ff7f52d-6cc1-4acc-b20c-6f4d2971a3c6,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:14.674802 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-2fe26ca6-f27a-4cf8-9813-eaf00421a15d req-cabeb33d-e54f-4d9a-a1e2-25f864e12109 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Unset dirty status for tenant:16e81170a75c4b11a58e6d70b30c98b7 on resource:security_group {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:20:14.694810 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2fe26ca6-f27a-4cf8-9813-eaf00421a15d req-cabeb33d-e54f-4d9a-a1e2-25f864e12109 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/security-groups?id=165e01bc-53ca-416e-93c5-98db294169b6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.6644287
May 31 16:20:14.729667 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-61dacc3c-74f3-44c5-8e84-5c01c437ebaf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.245s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:14.793696 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device a2424563-d6d6-443a-a1ac-cb2782c1c228 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:20:14.902305 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.db [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] For port db126eb4-e252-4765-86f1-09d3f20549df, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91766) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:20:14.919472 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.db [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] For port db126eb4-e252-4765-86f1-09d3f20549df, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=db126eb4-e252-4765-86f1-09d3f20549df,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91766) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:20:14.926856 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:14.932762 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-9ae1ff44-3b31-4294-a63d-12f5399e3d92 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:14.999879 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port a2424563-d6d6-443a-a1ac-cb2782c1c228 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:20:15.006328 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port a2424563-d6d6-443a-a1ac-cb2782c1c228 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:20:15.006813 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:15.021167 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-61dacc3c-74f3-44c5-8e84-5c01c437ebaf admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=f011071ed83e46f1b69a540c3daca061&name=default HTTP/1.1" status: 200  len: 2979 time: 2.3575981
May 31 16:20:15.045027 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 57016) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:15.197170 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] Routers {'8471b167-8540-4806-9932-e05fcb75a12b'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:20:15.199600 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f142701fc10>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:20:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['8471b167-8540-4806-9932-e05fcb75a12b'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:20:15.391291 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:15.511007 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port a2424563-d6d6-443a-a1ac-cb2782c1c228, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=a2424563-d6d6-443a-a1ac-cb2782c1c228,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:20:15.513058 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a8fc355-95eb-4e61-8c5d-7c1b25c8ee47 None None] Pushing event updated for resources: {'Port': ['ID=db126eb4-e252-4765-86f1-09d3f20549df,revision_number=4']} {{(pid=91766) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:15.522046 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-8a8fc355-95eb-4e61-8c5d-7c1b25c8ee47 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.589s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:15.526226 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:15.536725 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:15.615974 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.db.resource_extend [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] It took 0.53 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
May 31 16:20:15.656472 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 57038) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:15.786351 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-158fa2ea-3fd1-41f3-b85f-beab84a26ce2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Request body: {'security_group': {'name': 'tempest-securitygroup--2036917356', 'description': 'tempest-description--235562489'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:20:15.800680 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Router d7d26526-a6db-4e30-b1f1-233672c995e8 has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91763) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:20:15.801931 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=a2424563-d6d6-443a-a1ac-cb2782c1c228,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:15.843156 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.305s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:15.861606 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-158fa2ea-3fd1-41f3-b85f-beab84a26ce2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:15.887044 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-158fa2ea-3fd1-41f3-b85f-beab84a26ce2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Usage tracker for resource:security_group and tenant:12203182731d4a61acb7fc5914aef425 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:15.889375 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0e5a85ae-aafa-4bae-adee-5fc58eaad298 {{(pid=91764) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:20:15.905445 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] Set router 8471b167-8540-4806-9932-e05fcb75a12b gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:20:15.907121 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Notify callbacks [] for port, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:15.910965 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-158fa2ea-3fd1-41f3-b85f-beab84a26ce2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:15.919979 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-158fa2ea-3fd1-41f3-b85f-beab84a26ce2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:15.938599 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.provisioning_blocks [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Transition to ACTIVE for port object 0e5a85ae-aafa-4bae-adee-5fc58eaad298 will not be triggered until provisioned by entity L2. {{(pid=91764) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:20:15.954403 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:15.956540 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5591c8db-5905-4285-84f7-5743de100fc2 {{(pid=91763) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:20:16.033203 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:16.098408 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Notify callbacks [] for port, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:16.146059 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-158fa2ea-3fd1-41f3-b85f-beab84a26ce2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:16.250356 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.provisioning_blocks [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Transition to ACTIVE for port object 5591c8db-5905-4285-84f7-5743de100fc2 will not be triggered until provisioned by entity L2. {{(pid=91763) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:20:16.252688 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-158fa2ea-3fd1-41f3-b85f-beab84a26ce2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:16.256905 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c3863eb0-d7f2-4231-a343-7aff37c67aa0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:16.285469 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:16.288059 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-158fa2ea-3fd1-41f3-b85f-beab84a26ce2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Usage tracker for resource:security_group_rule and tenant:12203182731d4a61acb7fc5914aef425 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:16.293621 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05fd513b-14d1-4161-84a2-97957af72423 req-1539cb74-8de5-4c9a-b2e8-90fb1bb4066a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:16.295367 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-05fd513b-14d1-4161-84a2-97957af72423 req-1539cb74-8de5-4c9a-b2e8-90fb1bb4066a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 931 time: 0.8077290
May 31 16:20:16.485000 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-158fa2ea-3fd1-41f3-b85f-beab84a26ce2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:16.505662 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-158fa2ea-3fd1-41f3-b85f-beab84a26ce2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:16.532517 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c3863eb0-d7f2-4231-a343-7aff37c67aa0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:16.550643 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f142701fc10>, [{'id': '8471b167-8540-4806-9932-e05fcb75a12b', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:55Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '12203182731d4a61acb7fc5914aef425', 'gw_port': {'id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:83:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:19:56Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': 'db126eb4-e252-4765-86f1-09d3f20549df', 'name': '', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'mac_address': 'fa:16:3e:63:bd:f1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:04Z', 'updated_at': '2021-05-31T16:20:14Z', 'revision_number': 4, 'project_id': '12203182731d4a61acb7fc5914aef425', 'subnets': [{'id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:20:16.559124 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f3205a8-e04f-4293-97b4-7ee3b4378d10 None None] The sync data for ids ['8471b167-8540-4806-9932-e05fcb75a12b'] in dv-cinder-793814-1-iscsi is: [{'id': '8471b167-8540-4806-9932-e05fcb75a12b', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:55Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '12203182731d4a61acb7fc5914aef425', 'gw_port': {'id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:83:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:19:56Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': 'db126eb4-e252-4765-86f1-09d3f20549df', 'name': '', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'mac_address': 'fa:16:3e:63:bd:f1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:04Z', 'updated_at': '2021-05-31T16:20:14Z', 'revision_number': 4, 'project_id': '12203182731d4a61acb7fc5914aef425', 'subnets': [{'id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:20:16.583592 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device a2424563-d6d6-443a-a1ac-cb2782c1c228 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:20:16.668747 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c3863eb0-d7f2-4231-a343-7aff37c67aa0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:16.713192 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Pushing event updated for resources: {'Port': ['ID=0e5a85ae-aafa-4bae-adee-5fc58eaad298,revision_number=2']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:16.727719 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4f7a53e-2451-4b8a-84ef-9e637a8a493f req-3c3e64c7-e897-40db-be79-467d06456179 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:16.736034 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a4f7a53e-2451-4b8a-84ef-9e637a8a493f req-3c3e64c7-e897-40db-be79-467d06456179 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 944 time: 0.7286575
May 31 16:20:16.824665 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-158fa2ea-3fd1-41f3-b85f-beab84a26ce2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:16.866167 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:16.882067 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.849s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:16.900333 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-73a52256-1224-473e-b9f7-6e957f6ffb54 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.192s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:16.914996 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port a2424563-d6d6-443a-a1ac-cb2782c1c228 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:20:16.915580 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:16.941863 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c3863eb0-d7f2-4231-a343-7aff37c67aa0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:16.944847 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-c3863eb0-d7f2-4231-a343-7aff37c67aa0 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/9ff7f52d-6cc1-4acc-b20c-6f4d2971a3c6 HTTP/1.1" status: 204  len: 168 time: 1.8791277
May 31 16:20:16.987586 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-05fd513b-14d1-4161-84a2-97957af72423 req-43986730-9707-469f-8694-c25da50d01ca tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3654361
May 31 16:20:17.003142 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3863eb0-d7f2-4231-a343-7aff37c67aa0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9ff7f52d-6cc1-4acc-b20c-6f4d2971a3c6,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:17.022540 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c3863eb0-d7f2-4231-a343-7aff37c67aa0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:17.048589 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Attempting to bind port 0e5a85ae-aafa-4bae-adee-5fc58eaad298 on host hv-cinder-79381 for vnic_type normal with profile  {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:20:17.050234 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Attempting to bind port 0e5a85ae-aafa-4bae-adee-5fc58eaad298 by drivers openvswitch,hyperv on host hv-cinder-79381 at level 0 using segments [{'id': '5d13bef9-5e34-4b31-8817-4dba0534b3a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': 'c99513ad-3df3-429c-a5ba-a2334e5c92fc'}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:20:17.052395 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Attempting to bind port 0e5a85ae-aafa-4bae-adee-5fc58eaad298 on network c99513ad-3df3-429c-a5ba-a2334e5c92fc {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:20:17.069634 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Port 0e5a85ae-aafa-4bae-adee-5fc58eaad298 on network c99513ad-3df3-429c-a5ba-a2334e5c92fc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79381 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 31 16:20:17.073256 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Attempting to bind port 0e5a85ae-aafa-4bae-adee-5fc58eaad298 on network c99513ad-3df3-429c-a5ba-a2334e5c92fc {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:20:17.106718 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a4f7a53e-2451-4b8a-84ef-9e637a8a493f req-7079727a-ddd5-41b0-898d-c00ec5cbbb25 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/security-groups?id=165e01bc-53ca-416e-93c5-98db294169b6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3691795
May 31 16:20:17.116320 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Checking agent: {'id': '4bed2638-4d91-4afb-bf81-aacca8584621', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79381', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'started_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 19, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:20:17.116689 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Checking segment: {'id': '5d13bef9-5e34-4b31-8817-4dba0534b3a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': 'c99513ad-3df3-429c-a5ba-a2334e5c92fc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:20:17.117293 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Bound using segment: {'id': '5d13bef9-5e34-4b31-8817-4dba0534b3a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': 'c99513ad-3df3-429c-a5ba-a2334e5c92fc'} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:20:17.117894 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Bound port: 0e5a85ae-aafa-4bae-adee-5fc58eaad298, host: hv-cinder-79381, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5d13bef9-5e34-4b31-8817-4dba0534b3a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': 'c99513ad-3df3-429c-a5ba-a2334e5c92fc'}}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:20:17.118253 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:17.138349 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Pushing event updated for resources: {'Port': ['ID=5591c8db-5905-4285-84f7-5743de100fc2,revision_number=2']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:17.142766 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:20:17.160114 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-158fa2ea-3fd1-41f3-b85f-beab84a26ce2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:17.163034 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.297s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:17.211640 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] 10.222.0.43 "PUT /v2.0/routers/d7d26526-a6db-4e30-b1f1-233672c995e8/add_router_interface HTTP/1.1" status: 200  len: 503 time: 11.5984948
May 31 16:20:17.211640 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e1c35139-fce0-4a2a-adad-225ba846c29e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:17.267047 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] Sync routers for ids ['d7d26526-a6db-4e30-b1f1-233672c995e8'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:20:17.318514 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] Routers {'d7d26526-a6db-4e30-b1f1-233672c995e8'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:20:17.329033 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426637af0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:20:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['d7d26526-a6db-4e30-b1f1-233672c995e8'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:20:17.439714 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-158fa2ea-3fd1-41f3-b85f-beab84a26ce2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:17.441257 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-158fa2ea-3fd1-41f3-b85f-beab84a26ce2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 1.7813010
May 31 16:20:17.452116 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 57072) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:17.512757 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-b83de784-8764-4484-ac67-f22829f9fac7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Request body: {'security_group_rule': {'security_group_id': 'd7103354-0273-4035-bb29-eefdd75b99c9', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:20:17.560658 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-b83de784-8764-4484-ac67-f22829f9fac7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:17.592200 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-b83de784-8764-4484-ac67-f22829f9fac7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Usage tracker for resource:security_group_rule and tenant:12203182731d4a61acb7fc5914aef425 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:17.629822 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-b83de784-8764-4484-ac67-f22829f9fac7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:17.661789 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158fa2ea-3fd1-41f3-b85f-beab84a26ce2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d7103354-0273-4035-bb29-eefdd75b99c9,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:17.679246 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-b83de784-8764-4484-ac67-f22829f9fac7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:17.728195 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] For port 0e5a85ae-aafa-4bae-adee-5fc58eaad298, host hv-cinder-79381, cleared binding levels {{(pid=91764) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:20:17.744682 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] For port 0e5a85ae-aafa-4bae-adee-5fc58eaad298, host hv-cinder-79381, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=0e5a85ae-aafa-4bae-adee-5fc58eaad298,segment=NetworkSegment(5d13bef9-5e34-4b31-8817-4dba0534b3a7),segment_id=5d13bef9-5e34-4b31-8817-4dba0534b3a7)] {{(pid=91764) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:20:17.751029 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-158fa2ea-3fd1-41f3-b85f-beab84a26ce2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.545s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:17.756183 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b83de784-8764-4484-ac67-f22829f9fac7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:17.771556 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:17.821881 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:17.841661 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-253cbbd1-4113-499a-876d-665010b3bb21 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:17.844954 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Attempting to bind port 5591c8db-5905-4285-84f7-5743de100fc2 on host hv-cinder-79381 for vnic_type normal with profile  {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:20:17.847717 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Attempting to bind port 5591c8db-5905-4285-84f7-5743de100fc2 by drivers openvswitch,hyperv on host hv-cinder-79381 at level 0 using segments [{'id': '016e9daa-b906-4ec8-978d-cb58fbcd78da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2'}] {{(pid=91763) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:20:17.848332 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Attempting to bind port 5591c8db-5905-4285-84f7-5743de100fc2 on network 1097eeec-06a4-406d-ab4a-02e0123072d2 {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:20:17.859136 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Port 5591c8db-5905-4285-84f7-5743de100fc2 on network 1097eeec-06a4-406d-ab4a-02e0123072d2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79381 {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 31 16:20:17.861783 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Attempting to bind port 5591c8db-5905-4285-84f7-5743de100fc2 on network 1097eeec-06a4-406d-ab4a-02e0123072d2 {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:20:17.890315 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Checking agent: {'id': '4bed2638-4d91-4afb-bf81-aacca8584621', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79381', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'started_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 20, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:20:17.902281 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Checking segment: {'id': '016e9daa-b906-4ec8-978d-cb58fbcd78da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91763) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:20:17.904601 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Bound using segment: {'id': '016e9daa-b906-4ec8-978d-cb58fbcd78da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2'} {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:20:17.906710 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Bound port: 5591c8db-5905-4285-84f7-5743de100fc2, host: hv-cinder-79381, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '016e9daa-b906-4ec8-978d-cb58fbcd78da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2'}}] {{(pid=91763) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:20:17.907340 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:18.103341 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:18.125561 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:18.127380 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] 10.222.0.63 "PUT /v2.0/ports/0e5a85ae-aafa-4bae-adee-5fc58eaad298 HTTP/1.1" status: 200  len: 1094 time: 4.6703651
May 31 16:20:18.138327 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1132cf94-cfb6-4b32-ae8b-ef0151475c72', 'tag': '0e5a85ae-aafa-4bae-adee-5fc58eaad298'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:20:18.174491 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] Set router d7d26526-a6db-4e30-b1f1-233672c995e8 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:20:18.559050 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] For port 5591c8db-5905-4285-84f7-5743de100fc2, host hv-cinder-79381, cleared binding levels {{(pid=91763) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:20:18.571274 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] For port 5591c8db-5905-4285-84f7-5743de100fc2, host hv-cinder-79381, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=5591c8db-5905-4285-84f7-5743de100fc2,segment=NetworkSegment(016e9daa-b906-4ec8-978d-cb58fbcd78da),segment_id=016e9daa-b906-4ec8-978d-cb58fbcd78da)] {{(pid=91763) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:20:18.577499 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:18.587443 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:18.754007 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:18.759631 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:18.762391 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] 10.222.0.63 "PUT /v2.0/ports/5591c8db-5905-4285-84f7-5743de100fc2 HTTP/1.1" status: 200  len: 1093 time: 7.0134041
May 31 16:20:18.765168 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f08a2463-b6e4-494f-8f48-be855ffd203b', 'tag': '5591c8db-5905-4285-84f7-5743de100fc2'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:20:18.779330 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device db126eb4-e252-4765-86f1-09d3f20549df up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:20:18.907091 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-49de3f8b-8e84-48db-8885-2470c5da3273" -d '{"events": [{"name": "network-changed", "server_uuid": "1132cf94-cfb6-4b32-ae8b-ef0151475c72", "tag": "0e5a85ae-aafa-4bae-adee-5fc58eaad298"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:20:18.937480 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b83de784-8764-4484-ac67-f22829f9fac7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:19.012217 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b83de784-8764-4484-ac67-f22829f9fac7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:19.265323 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Pushing event updated for resources: {'Port': ['ID=5591c8db-5905-4285-84f7-5743de100fc2,revision_number=3']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:19.282474 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.695s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:19.289481 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Pushing event updated for resources: {'Port': ['ID=0e5a85ae-aafa-4bae-adee-5fc58eaad298,revision_number=3']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:19.307903 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.466s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:19.319311 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:19.402969 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-784ea313-cb37-4881-89ee-a8bb8d859f15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:19.414010 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-784ea313-cb37-4881-89ee-a8bb8d859f15 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=0eb6e65b3f844417816fb1e5c88a8004&device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 1096 time: 0.4361670
May 31 16:20:19.445420 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port db126eb4-e252-4765-86f1-09d3f20549df completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:20:19.494783 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port db126eb4-e252-4765-86f1-09d3f20549df triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:20:19.495164 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:19.544968 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b83de784-8764-4484-ac67-f22829f9fac7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f16733d1-abe9-41e5-8a4a-71f5a94d119c,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:19.580816 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-adcfa4f3-01d6-4430-b2ea-57a339780aff service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=5591c8db-5905-4285-84f7-5743de100fc2 HTTP/1.1" status: 200  len: 217 time: 0.1502271
May 31 16:20:19.613816 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f4d6e8ce-939e-4a30-8f75-52066bf1a0b8" -d '{"events": [{"name": "network-changed", "server_uuid": "f08a2463-b6e4-494f-8f48-be855ffd203b", "tag": "5591c8db-5905-4285-84f7-5743de100fc2"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:20:19.616905 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-b83de784-8764-4484-ac67-f22829f9fac7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.297s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:19.675673 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-247f8ff8-be74-451e-9bac-658fedb3e415 req-774d853c-c250-4c73-bcde-9d1684c28c3f tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:19.677223 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-247f8ff8-be74-451e-9bac-658fedb3e415 req-774d853c-c250-4c73-bcde-9d1684c28c3f tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 943 time: 1.3692560
May 31 16:20:19.738972 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426637af0>, [{'id': 'd7d26526-a6db-4e30-b1f1-233672c995e8', 'name': 'tempest-ServerRescueNegativeTestJSON-1748311148-router', 'tenant_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.92'}], 'enable_snat': True}, 'gw_port_id': 'a2424563-d6d6-443a-a1ac-cb2782c1c228', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:59Z', 'updated_at': '2021-05-31T16:20:11Z', 'revision_number': 4, 'project_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'gw_port': {'id': 'a2424563-d6d6-443a-a1ac-cb2782c1c228', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:fe:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd7d26526-a6db-4e30-b1f1-233672c995e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.92', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:01Z', 'updated_at': '2021-05-31T16:20:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '13d2d45a-63a0-45f1-bfe6-b2f687e752e0', 'name': '', 'network_id': 'd89a2a7e-0a66-4cc2-94ab-1f50ba0056b1', 'tenant_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'mac_address': 'fa:16:3e:e9:88:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd7d26526-a6db-4e30-b1f1-233672c995e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'b9c806fb-2a53-4445-8352-4336429eb043', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:08Z', 'updated_at': '2021-05-31T16:20:12Z', 'revision_number': 2, 'project_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'subnets': [{'id': 'b9c806fb-2a53-4445-8352-4336429eb043', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:20:19.800891 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-01b1e328-8077-4c0e-b291-07e40844b188 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:19.803617 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-01b1e328-8077-4c0e-b291-07e40844b188 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=68c4d303-4299-4977-888e-57c80b8530cc HTTP/1.1" status: 200  len: 854 time: 0.1560366
May 31 16:20:19.809155 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] Checking router: d7d26526-a6db-4e30-b1f1-233672c995e8 for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:20:19.811907 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] Updating router d7d26526-a6db-4e30-b1f1-233672c995e8 port 13d2d45a-63a0-45f1-bfe6-b2f687e752e0 binding host dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 31 16:20:19.855995 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b83de784-8764-4484-ac67-f22829f9fac7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:19.860232 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-b83de784-8764-4484-ac67-f22829f9fac7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 2.4069455
May 31 16:20:19.881341 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 57154) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:19.890886 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-e7aa81ff-ddcc-4347-abe5-3f360f237bd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:19.891459 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-e7aa81ff-ddcc-4347-abe5-3f360f237bd6 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=16e81170a75c4b11a58e6d70b30c98b7&device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 1097 time: 1.5693507
May 31 16:20:19.909415 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-91c8b87f-137d-4ab5-b44b-2f83750c221d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Request body: {'security_group_rule': {'security_group_id': 'd7103354-0273-4035-bb29-eefdd75b99c9', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:20:19.942611 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-3680b229-ae72-4a43-a75d-3cf8b2933519 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=1097eeec-06a4-406d-ab4a-02e0123072d2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1283872
May 31 16:20:19.956271 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-5bd45ea0-fcb4-465a-8ca4-fddd7f5e2eb2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:19.957127 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-5bd45ea0-fcb4-465a-8ca4-fddd7f5e2eb2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Synchronizing usage tracker for tenant:1739d3c0e2734c8a9af5c5291aac8e25 on resource:network {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:20:19.962385 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-91c8b87f-137d-4ab5-b44b-2f83750c221d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:19.993917 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-247f8ff8-be74-451e-9bac-658fedb3e415 req-a4c6f2a5-3f90-459f-ada7-8dac221a00e2 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2738657
May 31 16:20:19.995182 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-91c8b87f-137d-4ab5-b44b-2f83750c221d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Usage tracker for resource:security_group_rule and tenant:12203182731d4a61acb7fc5914aef425 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:20.015602 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-91c8b87f-137d-4ab5-b44b-2f83750c221d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:20.034363 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-91c8b87f-137d-4ab5-b44b-2f83750c221d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:20.050781 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-5bd45ea0-fcb4-465a-8ca4-fddd7f5e2eb2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Unset dirty status for tenant:1739d3c0e2734c8a9af5c5291aac8e25 on resource:network {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:20:20.056156 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-5bd45ea0-fcb4-465a-8ca4-fddd7f5e2eb2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/networks?id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 HTTP/1.1" status: 200  len: 819 time: 1.4249310
May 31 16:20:20.083321 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:20.086755 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-91c8b87f-137d-4ab5-b44b-2f83750c221d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:20.113354 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:20.117034 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-eac353aa-565b-4d1a-86b2-e28bdefd6b55 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/quotas/1739d3c0e2734c8a9af5c5291aac8e25 HTTP/1.1" status: 200  len: 375 time: 0.0527318
May 31 16:20:20.435518 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port db126eb4-e252-4765-86f1-09d3f20549df, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=db126eb4-e252-4765-86f1-09d3f20549df,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:20:20.497286 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-315f2ca6-531d-4283-a934-a4ed7d2dd9d2 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=0e5a85ae-aafa-4bae-adee-5fc58eaad298 HTTP/1.1" status: 200  len: 217 time: 0.2716277
May 31 16:20:20.508591 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:20.532675 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:20.644474 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-91c8b87f-137d-4ab5-b44b-2f83750c221d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:20.654729 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-91c8b87f-137d-4ab5-b44b-2f83750c221d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:20.665295 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-c0e22f35-e40d-4132-88f9-b7ee2f8de2b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:20.667189 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-c0e22f35-e40d-4132-88f9-b7ee2f8de2b5 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=d6d29986-6b64-4e75-9065-dbd87b0b7ea3 HTTP/1.1" status: 200  len: 852 time: 0.1201208
May 31 16:20:20.672723 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-b83de784-8764-4484-ac67-f22829f9fac7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:20.735372 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91c8b87f-137d-4ab5-b44b-2f83750c221d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=02ad34e4-7ed6-425f-a0f0-8438c219dbc9,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:20.741187 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-1f39c5bc-76b0-45e8-b5d0-9025e7dac671 service neutron] 10.222.0.63 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5577376
May 31 16:20:20.763739 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-14eb24d4-5495-4175-8526-bf62120bd066 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=1739d3c0e2734c8a9af5c5291aac8e25&fields=id HTTP/1.1" status: 200  len: 255 time: 0.6394784
May 31 16:20:20.875596 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-91c8b87f-137d-4ab5-b44b-2f83750c221d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.203s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:20.899307 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e10db152-7e5f-49a7-80d9-0fce35e88e0e req-815a3796-091c-430b-9712-b4d606a2d13f tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:20.911257 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e10db152-7e5f-49a7-80d9-0fce35e88e0e req-815a3796-091c-430b-9712-b4d606a2d13f tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 944 time: 0.5578902
May 31 16:20:20.974374 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-91c8b87f-137d-4ab5-b44b-2f83750c221d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:20.983408 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-91c8b87f-137d-4ab5-b44b-2f83750c221d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 1.0877252
May 31 16:20:20.992467 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 57188) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:21.011402 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Request body: {'floatingip': {'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:20:21.028734 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-90101515-de68-4e6c-93fd-a89847c37eca service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=c99513ad-3df3-429c-a5ba-a2334e5c92fc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.2956631
May 31 16:20:21.029459 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:21.037337 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Usage tracker for resource:floatingip and tenant:12203182731d4a61acb7fc5914aef425 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:21.043486 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:21.052610 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:21.088223 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for floatingip, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:21.124513 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7ae6ad9e-a92f-400a-8be8-8e311bfa611c req-b2fc2c37-d1ec-49db-af3c-795197d09e7d service neutron] 10.222.0.63 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3231683
May 31 16:20:21.164755 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] Notify callbacks [] for port, precommit_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:21.200410 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] Transition to ACTIVE for port object 13d2d45a-63a0-45f1-bfe6-b2f687e752e0 will not be triggered until provisioned by entity L2. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:20:21.249364 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=db126eb4-e252-4765-86f1-09d3f20549df,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:21.264438 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:21.265903 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.742s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:21.290390 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:21.365054 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:21.509663 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e10db152-7e5f-49a7-80d9-0fce35e88e0e req-65e9bf48-f78d-4c4b-a412-664a9c4cae01 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/security-groups?id=165e01bc-53ca-416e-93c5-98db294169b6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.5959725
May 31 16:20:21.529357 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-3634175b-70d5-4b82-a0e8-3030310b7e81 service neutron] 10.222.0.63 "GET /v2.0/networks/c99513ad-3df3-429c-a5ba-a2334e5c92fc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2823296
May 31 16:20:21.652936 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Allocated IP 172.27.0.136 (00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c/96709d85-d0fe-4cf8-b232-eaf6b143ebe6/da864462-bb4e-4161-b635-28d836ab96b9) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:20:21.841946 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e4c3c92-09b4-4cbc-aa87-bc0d0fc8f5ad None None] Pushing event updated for resources: {'Port': ['ID=13d2d45a-63a0-45f1-bfe6-b2f687e752e0,revision_number=3']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:22.045168 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-1e4c3c92-09b4-4cbc-aa87-bc0d0fc8f5ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.755s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:22.071655 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:22.124235 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] Attempting to bind port 13d2d45a-63a0-45f1-bfe6-b2f687e752e0 on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:20:22.124733 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] Attempting to bind port 13d2d45a-63a0-45f1-bfe6-b2f687e752e0 by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '5a3941ae-d5de-4802-8fd8-3da6c1932b05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': 'd89a2a7e-0a66-4cc2-94ab-1f50ba0056b1'}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:20:22.125108 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] Attempting to bind port 13d2d45a-63a0-45f1-bfe6-b2f687e752e0 on network d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:20:22.140212 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 20, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:20:22.140679 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] Checking segment: {'id': '5a3941ae-d5de-4802-8fd8-3da6c1932b05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': 'd89a2a7e-0a66-4cc2-94ab-1f50ba0056b1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91765) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:20:22.141165 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:22.141590 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] Bound using segment: {'id': '5a3941ae-d5de-4802-8fd8-3da6c1932b05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': 'd89a2a7e-0a66-4cc2-94ab-1f50ba0056b1'} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:20:22.142087 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] Bound port: 13d2d45a-63a0-45f1-bfe6-b2f687e752e0, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5a3941ae-d5de-4802-8fd8-3da6c1932b05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': 'd89a2a7e-0a66-4cc2-94ab-1f50ba0056b1'}}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:20:22.147757 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:22.147902 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:22.148872 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:22.241023 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:20:22.245122 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:20:22.248658 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:20:22.328050 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:20:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c59a6763-43c2-4d08-837d-8fe1bbd0d8c1 x-openstack-request-id: req-c59a6763-43c2-4d08-837d-8fe1bbd0d8c1 {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:20:22.328467 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1132cf94-cfb6-4b32-ae8b-ef0151475c72", "tag": "0e5a85ae-aafa-4bae-adee-5fc58eaad298", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:20:22.331386 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-c59a6763-43c2-4d08-837d-8fe1bbd0d8c1 {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:20:22.334156 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1132cf94-cfb6-4b32-ae8b-ef0151475c72', 'tag': '0e5a85ae-aafa-4bae-adee-5fc58eaad298', 'status': 'completed', 'code': 200}
May 31 16:20:22.340390 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:22.374851 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-c17d54b5-5968-4a7c-bead-2f53d1012c0c service neutron] 10.222.0.43 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=segments HTTP/1.1" status: 200  len: 212 time: 1.6097858
May 31 16:20:22.389038 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:20:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e3a572ca-becb-4a98-8567-b43e507e95df x-openstack-request-id: req-e3a572ca-becb-4a98-8567-b43e507e95df {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:20:22.389238 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f08a2463-b6e4-494f-8f48-be855ffd203b", "tag": "5591c8db-5905-4285-84f7-5743de100fc2", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:20:22.389509 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-e3a572ca-becb-4a98-8567-b43e507e95df {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:20:22.390234 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f08a2463-b6e4-494f-8f48-be855ffd203b', 'tag': '5591c8db-5905-4285-84f7-5743de100fc2', 'status': 'completed', 'code': 200}
May 31 16:20:22.398248 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Pushing event updated for resources: {'Port': ['ID=da864462-bb4e-4161-b635-28d836ab96b9,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:22.404263 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.255s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:22.405581 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] For port 13d2d45a-63a0-45f1-bfe6-b2f687e752e0, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91765) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:20:22.417054 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] For port 13d2d45a-63a0-45f1-bfe6-b2f687e752e0, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=13d2d45a-63a0-45f1-bfe6-b2f687e752e0,segment=NetworkSegment(5a3941ae-d5de-4802-8fd8-3da6c1932b05),segment_id=5a3941ae-d5de-4802-8fd8-3da6c1932b05)] {{(pid=91765) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:20:22.426301 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:22.432188 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:22.672129 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] Routers {'d7d26526-a6db-4e30-b1f1-233672c995e8'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:20:22.672801 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426637af0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:20:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['d7d26526-a6db-4e30-b1f1-233672c995e8'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:20:22.682868 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:22.698039 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-197b5d19-efae-4e1a-a096-7ec8e7b8f798 req-64bd1eae-2889-4200-8c13-598ae5c16b68 service neutron] 10.222.0.63 "GET /v2.0/networks/c99513ad-3df3-429c-a5ba-a2334e5c92fc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 1.1479685
May 31 16:20:22.827977 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device db126eb4-e252-4765-86f1-09d3f20549df up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:20:22.904612 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-a5011f2d-681f-4b20-86c7-91332da12799 service neutron] 10.222.0.43 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5255790
May 31 16:20:22.917167 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e4c3c92-09b4-4cbc-aa87-bc0d0fc8f5ad None None] Pushing event updated for resources: {'Port': ['ID=13d2d45a-63a0-45f1-bfe6-b2f687e752e0,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:22.934681 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-1e4c3c92-09b4-4cbc-aa87-bc0d0fc8f5ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.502s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:22.968350 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36065c10-9c94-47ae-84fa-14d1a1f11e7f req-bd919d3b-33af-41f9-8a1f-cc3a46c47680 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:22.981270 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-36065c10-9c94-47ae-84fa-14d1a1f11e7f req-bd919d3b-33af-41f9-8a1f-cc3a46c47680 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 943 time: 0.3010011
May 31 16:20:23.202944 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-36065c10-9c94-47ae-84fa-14d1a1f11e7f req-d5eca43d-1776-4d3a-be3a-0d8c5ea47ea3 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2193222
May 31 16:20:23.234972 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49de3f8b-8e84-48db-8885-2470c5da3273 req-113f0067-4f2e-4380-bd03-d72b48799a6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:23.237152 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-49de3f8b-8e84-48db-8885-2470c5da3273 req-113f0067-4f2e-4380-bd03-d72b48799a6f service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=16e81170a75c4b11a58e6d70b30c98b7&device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 1097 time: 0.4138494
May 31 16:20:23.237431 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port db126eb4-e252-4765-86f1-09d3f20549df triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:20:23.242080 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:23.376738 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] Set router d7d26526-a6db-4e30-b1f1-233672c995e8 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:20:23.551250 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a2955c74-10b2-493a-996b-63661d7cd298 req-bdeb277b-2835-41cc-a454-39fa63fd3b7f tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 210 time: 0.1892967
May 31 16:20:23.686199 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d6e8ce-939e-4a30-8f75-52066bf1a0b8 req-2ed99e91-353b-4ff5-9d90-2842cbe504e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:23.688658 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-f4d6e8ce-939e-4a30-8f75-52066bf1a0b8 req-2ed99e91-353b-4ff5-9d90-2842cbe504e5 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=0eb6e65b3f844417816fb1e5c88a8004&device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 1096 time: 1.2759159
May 31 16:20:23.692926 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for port, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:23.702366 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:23.709349 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-7a42f72e-444a-4140-beaf-77a5773c957e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:23.834197 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16621821'] for floatingip, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:23.850505 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49de3f8b-8e84-48db-8885-2470c5da3273 req-8a0aa772-48fc-4fcf-9ca2-f0d734b12766 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:23.853288 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-49de3f8b-8e84-48db-8885-2470c5da3273 req-8a0aa772-48fc-4fcf-9ca2-f0d734b12766 service neutron] 10.222.0.63 "GET /v2.0/networks?id=c99513ad-3df3-429c-a5ba-a2334e5c92fc HTTP/1.1" status: 200  len: 913 time: 0.6093769
May 31 16:20:23.952905 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Pushing event updated for resources: {'Port': ['ID=da864462-bb4e-4161-b635-28d836ab96b9,revision_number=2']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:23.959628 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.251s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:23.964236 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for floatingip, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:23.965483 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 2.9716868
May 31 16:20:24.024743 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d6e8ce-939e-4a30-8f75-52066bf1a0b8 req-29d5e13d-b607-421d-867e-8e0f6267b216 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:24.026254 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-f4d6e8ce-939e-4a30-8f75-52066bf1a0b8 req-29d5e13d-b607-421d-867e-8e0f6267b216 service neutron] 10.222.0.63 "GET /v2.0/networks?id=1097eeec-06a4-406d-ab4a-02e0123072d2 HTTP/1.1" status: 200  len: 915 time: 0.2423370
May 31 16:20:24.135912 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-49de3f8b-8e84-48db-8885-2470c5da3273 req-6b75e8fb-9e48-446c-a2a1-ee465f739e7b service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=0e5a85ae-aafa-4bae-adee-5fc58eaad298 HTTP/1.1" status: 200  len: 217 time: 0.2617590
May 31 16:20:24.224677 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7163ef0f-e3ca-4388-ae26-dacd5356e14c req-a6db0293-0579-44cb-9582-78b293f406d5 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:24.228914 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7163ef0f-e3ca-4388-ae26-dacd5356e14c req-a6db0293-0579-44cb-9582-78b293f406d5 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 944 time: 0.6678760
May 31 16:20:24.348083 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-f4d6e8ce-939e-4a30-8f75-52066bf1a0b8 req-2d5c3d06-34a3-4d1d-a257-14411452fe52 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=5591c8db-5905-4285-84f7-5743de100fc2 HTTP/1.1" status: 200  len: 217 time: 0.2315469
May 31 16:20:24.518944 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d6e8ce-939e-4a30-8f75-52066bf1a0b8 req-da384bd9-71a6-49ce-9665-785b242df193 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:24.520859 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-f4d6e8ce-939e-4a30-8f75-52066bf1a0b8 req-da384bd9-71a6-49ce-9665-785b242df193 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=68c4d303-4299-4977-888e-57c80b8530cc HTTP/1.1" status: 200  len: 854 time: 0.1646514
May 31 16:20:24.562081 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-795b9080-93de-48ed-9951-f03100b57844 req-f8dd279d-7e06-40d6-9aae-a23604bf1178 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:24.563997 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-795b9080-93de-48ed-9951-f03100b57844 req-f8dd279d-7e06-40d6-9aae-a23604bf1178 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/networks?id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 HTTP/1.1" status: 200  len: 819 time: 0.4270368
May 31 16:20:24.579559 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49de3f8b-8e84-48db-8885-2470c5da3273 req-2d14445f-35a2-46d4-93e9-d782a4106379 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:24.581843 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-49de3f8b-8e84-48db-8885-2470c5da3273 req-2d14445f-35a2-46d4-93e9-d782a4106379 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=d6d29986-6b64-4e75-9065-dbd87b0b7ea3 HTTP/1.1" status: 200  len: 852 time: 0.3795080
May 31 16:20:24.617646 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426637af0>, [{'id': 'd7d26526-a6db-4e30-b1f1-233672c995e8', 'name': 'tempest-ServerRescueNegativeTestJSON-1748311148-router', 'tenant_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.92'}], 'enable_snat': True}, 'gw_port_id': 'a2424563-d6d6-443a-a1ac-cb2782c1c228', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:59Z', 'updated_at': '2021-05-31T16:20:11Z', 'revision_number': 4, 'project_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'gw_port': {'id': 'a2424563-d6d6-443a-a1ac-cb2782c1c228', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:fe:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd7d26526-a6db-4e30-b1f1-233672c995e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.92', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:01Z', 'updated_at': '2021-05-31T16:20:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '13d2d45a-63a0-45f1-bfe6-b2f687e752e0', 'name': '', 'network_id': 'd89a2a7e-0a66-4cc2-94ab-1f50ba0056b1', 'tenant_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'mac_address': 'fa:16:3e:e9:88:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd7d26526-a6db-4e30-b1f1-233672c995e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'b9c806fb-2a53-4445-8352-4336429eb043', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:08Z', 'updated_at': '2021-05-31T16:20:22Z', 'revision_number': 4, 'project_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'subnets': [{'id': 'b9c806fb-2a53-4445-8352-4336429eb043', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:20:24.619759 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-f4d6e8ce-939e-4a30-8f75-52066bf1a0b8 req-6e156a2a-d091-4a45-847e-a99fce21d199 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=1097eeec-06a4-406d-ab4a-02e0123072d2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0855205
May 31 16:20:24.624264 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7163ef0f-e3ca-4388-ae26-dacd5356e14c req-eab84572-96a4-4b84-947a-1cdfc9b3f796 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/security-groups?id=165e01bc-53ca-416e-93c5-98db294169b6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3016286
May 31 16:20:24.625686 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8a7ea20-38a6-45f7-a9c5-29bce4c79ea6 None None] The sync data for ids ['d7d26526-a6db-4e30-b1f1-233672c995e8'] in dv-cinder-793814-1-iscsi is: [{'id': 'd7d26526-a6db-4e30-b1f1-233672c995e8', 'name': 'tempest-ServerRescueNegativeTestJSON-1748311148-router', 'tenant_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.92'}], 'enable_snat': True}, 'gw_port_id': 'a2424563-d6d6-443a-a1ac-cb2782c1c228', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:59Z', 'updated_at': '2021-05-31T16:20:11Z', 'revision_number': 4, 'project_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'gw_port': {'id': 'a2424563-d6d6-443a-a1ac-cb2782c1c228', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:fe:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd7d26526-a6db-4e30-b1f1-233672c995e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.92', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:01Z', 'updated_at': '2021-05-31T16:20:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '13d2d45a-63a0-45f1-bfe6-b2f687e752e0', 'name': '', 'network_id': 'd89a2a7e-0a66-4cc2-94ab-1f50ba0056b1', 'tenant_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'mac_address': 'fa:16:3e:e9:88:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd7d26526-a6db-4e30-b1f1-233672c995e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'b9c806fb-2a53-4445-8352-4336429eb043', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:08Z', 'updated_at': '2021-05-31T16:20:22Z', 'revision_number': 4, 'project_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'subnets': [{'id': 'b9c806fb-2a53-4445-8352-4336429eb043', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:20:24.673282 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-795b9080-93de-48ed-9951-f03100b57844 req-25aad2cf-e22b-4d0c-b49e-27cb5bfc20ae tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/quotas/1739d3c0e2734c8a9af5c5291aac8e25 HTTP/1.1" status: 200  len: 375 time: 0.0848296
May 31 16:20:24.735063 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-49de3f8b-8e84-48db-8885-2470c5da3273 req-f3483ff0-a9f8-47fd-8b5f-c6444836a70a service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=c99513ad-3df3-429c-a5ba-a2334e5c92fc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1097729
May 31 16:20:25.001941 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 57328) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:25.006360 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-f4d6e8ce-939e-4a30-8f75-52066bf1a0b8 req-1ef4d0a6-db05-4cc7-8121-c11a13ee3b46 service neutron] 10.222.0.63 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3786976
May 31 16:20:25.048699 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 57334) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:25.062479 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-49de3f8b-8e84-48db-8885-2470c5da3273 req-2a7d7043-23cb-4e18-92ad-fd7cd392a4b9 service neutron] 10.222.0.63 "GET /v2.0/networks/c99513ad-3df3-429c-a5ba-a2334e5c92fc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3175151
May 31 16:20:25.152688 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-795b9080-93de-48ed-9951-f03100b57844 req-77d4928c-514a-4fd2-baec-451ee36dcb75 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=1739d3c0e2734c8a9af5c5291aac8e25&fields=id HTTP/1.1" status: 200  len: 255 time: 0.4782522
May 31 16:20:25.200826 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-f4d6e8ce-939e-4a30-8f75-52066bf1a0b8 req-86421835-17d8-406c-9a37-47b497af6809 service neutron] 10.222.0.63 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1870742
May 31 16:20:25.223425 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c42d3d32-c73f-41a6-94d0-20e6c77ad8e7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:25.296466 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-92ad1dbe-4a78-4cac-873f-d39da1dee09c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:25.325721 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-92ad1dbe-4a78-4cac-873f-d39da1dee09c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:25.329669 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-92ad1dbe-4a78-4cac-873f-d39da1dee09c admin admin] Usage tracker for resource:security_group_rule and tenant:45b9daf8e474429d86b7f6c389e322c5 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:25.332820 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-92ad1dbe-4a78-4cac-873f-d39da1dee09c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:25.339317 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-92ad1dbe-4a78-4cac-873f-d39da1dee09c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:25.496882 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-49de3f8b-8e84-48db-8885-2470c5da3273 req-7261f4be-da4b-4d0c-b66e-21679c1c6eb0 service neutron] 10.222.0.63 "GET /v2.0/networks/c99513ad-3df3-429c-a5ba-a2334e5c92fc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4172425
May 31 16:20:25.506215 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcc76b8e-5f8e-4675-97d3-1166787cbf0d req-e50e3e30-871a-419b-8241-fb3c997bd834 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:25.508925 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-dcc76b8e-5f8e-4675-97d3-1166787cbf0d req-e50e3e30-871a-419b-8241-fb3c997bd834 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 943 time: 0.6264770
May 31 16:20:25.512383 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-c42d3d32-c73f-41a6-94d0-20e6c77ad8e7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:25.638208 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-92ad1dbe-4a78-4cac-873f-d39da1dee09c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:25.647641 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-92ad1dbe-4a78-4cac-873f-d39da1dee09c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:25.656194 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-c42d3d32-c73f-41a6-94d0-20e6c77ad8e7 admin admin] Usage tracker for resource:security_group_rule and tenant:ebee59cfa4ef4538949afc353cd433a0 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:25.664361 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-c42d3d32-c73f-41a6-94d0-20e6c77ad8e7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:25.676179 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:25.688070 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-c42d3d32-c73f-41a6-94d0-20e6c77ad8e7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:25.710676 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92ad1dbe-4a78-4cac-873f-d39da1dee09c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f28e0835-8890-4990-bd79-ea3c93a37607,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:25.727314 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-92ad1dbe-4a78-4cac-873f-d39da1dee09c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:25.746300 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-795b9080-93de-48ed-9951-f03100b57844 req-3d8bcccd-ac62-4c94-828a-24cf98598a16 service neutron] 10.222.0.43 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5922823
May 31 16:20:25.749058 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-d6ae198c-99d4-4dc2-ae43-baccdaf3b160 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:25.751356 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-d6ae198c-99d4-4dc2-ae43-baccdaf3b160 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.63 "GET /v2.0/networks?id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 HTTP/1.1" status: 200  len: 819 time: 0.3211584
May 31 16:20:25.766815 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-92ad1dbe-4a78-4cac-873f-d39da1dee09c admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=45b9daf8e474429d86b7f6c389e322c5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7144167
May 31 16:20:25.769643 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-884c95a4-1b55-4103-bf03-13f226c8c08d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Request body: {'port': {'device_id': 'b75c28e8-2e51-4a0b-b6bc-9e946d07877d', 'network_id': 'd89a2a7e-0a66-4cc2-94ab-1f50ba0056b1', 'admin_state_up': True, 'tenant_id': '1739d3c0e2734c8a9af5c5291aac8e25'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:20:25.783698 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 57352) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:25.796752 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-dcc76b8e-5f8e-4675-97d3-1166787cbf0d req-14fe7791-e701-49fe-9113-6d2032cdbfe0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2786455
May 31 16:20:25.943891 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-c92d2774-88ad-4006-a392-f33beb0faa56 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:25.990174 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-795b9080-93de-48ed-9951-f03100b57844 req-48fa7d48-99e3-4060-95cf-86c82d3e82d6 service neutron] 10.222.0.43 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2338002
May 31 16:20:25.997445 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-c92d2774-88ad-4006-a392-f33beb0faa56 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:26.025985 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c42d3d32-c73f-41a6-94d0-20e6c77ad8e7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:26.031549 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-f6c7dba2-5eb1-42a6-a9db-27cc70d36186 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Synchronizing usage tracker for tenant:12203182731d4a61acb7fc5914aef425 on resource:security_group {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:20:26.037633 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c42d3d32-c73f-41a6-94d0-20e6c77ad8e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:26.052606 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-45e73ec3-5e21-4089-81f4-1c3b2c42a411 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:26.067957 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-884c95a4-1b55-4103-bf03-13f226c8c08d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:26.072588 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-884c95a4-1b55-4103-bf03-13f226c8c08d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Usage tracker for resource:port and tenant:1739d3c0e2734c8a9af5c5291aac8e25 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:26.077108 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-884c95a4-1b55-4103-bf03-13f226c8c08d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Quota usage for port was recalculated. Used quota:1. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:26.085490 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-884c95a4-1b55-4103-bf03-13f226c8c08d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:26.105382 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-884c95a4-1b55-4103-bf03-13f226c8c08d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Made reservation on behalf of 1739d3c0e2734c8a9af5c5291aac8e25 for: {'port': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:20:26.108097 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-f6c7dba2-5eb1-42a6-a9db-27cc70d36186 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Unset dirty status for tenant:12203182731d4a61acb7fc5914aef425 on resource:security_group {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:20:26.109718 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-884c95a4-1b55-4103-bf03-13f226c8c08d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:26.116130 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-f6c7dba2-5eb1-42a6-a9db-27cc70d36186 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-securitygroup--2036917356&fields=id&tenant_id=12203182731d4a61acb7fc5914aef425 HTTP/1.1" status: 200  len: 267 time: 0.1825461
May 31 16:20:26.120627 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-c42d3d32-c73f-41a6-94d0-20e6c77ad8e7 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=ebee59cfa4ef4538949afc353cd433a0&name=default HTTP/1.1" status: 200  len: 2979 time: 1.1072326
May 31 16:20:26.124958 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 57368) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:26.171061 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c42d3d32-c73f-41a6-94d0-20e6c77ad8e7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a839e0d-09f5-4d10-804a-46c94911962c,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:26.175135 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c42d3d32-c73f-41a6-94d0-20e6c77ad8e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:26.273988 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-c92d2774-88ad-4006-a392-f33beb0faa56 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:26.288701 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-158fa2ea-3fd1-41f3-b85f-beab84a26ce2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:26.308225 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c92d2774-88ad-4006-a392-f33beb0faa56 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f28e0835-8890-4990-bd79-ea3c93a37607,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:26.347486 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-884c95a4-1b55-4103-bf03-13f226c8c08d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Allocated IP 172.20.0.11 (d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1/b9c806fb-2a53-4445-8352-4336429eb043/f99df66c-c850-4d01-80ae-3d312eee69db) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:20:26.357348 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-c92d2774-88ad-4006-a392-f33beb0faa56 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:26.401257 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-c92d2774-88ad-4006-a392-f33beb0faa56 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:26.405038 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-c92d2774-88ad-4006-a392-f33beb0faa56 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/f28e0835-8890-4990-bd79-ea3c93a37607 HTTP/1.1" status: 204  len: 168 time: 0.6154313
May 31 16:20:26.420556 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-9e044e4b-ca4e-4735-b45b-df1ea776f412 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:26.421266 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-9e044e4b-ca4e-4735-b45b-df1ea776f412 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Synchronizing usage tracker for tenant:12203182731d4a61acb7fc5914aef425 on resource:network {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:20:26.431816 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5e0fe959-cba8-4ec0-bbcb-a3f26ed9efa0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:26.482562 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5e0fe959-cba8-4ec0-bbcb-a3f26ed9efa0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:26.498925 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ab455ca-fb43-41cd-84b0-dbd17ec4a116 req-b43c63ad-8244-47be-b9db-24463bb6ea1b tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:26.500454 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7ab455ca-fb43-41cd-84b0-dbd17ec4a116 req-b43c63ad-8244-47be-b9db-24463bb6ea1b tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 944 time: 0.2602029
May 31 16:20:26.504910 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-9e044e4b-ca4e-4735-b45b-df1ea776f412 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Unset dirty status for tenant:12203182731d4a61acb7fc5914aef425 on resource:network {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:20:26.505559 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-9e044e4b-ca4e-4735-b45b-df1ea776f412 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/networks?id=be7d7603-734f-43bb-92a8-ed07a835aeb5 HTTP/1.1" status: 200  len: 816 time: 0.3884957
May 31 16:20:26.559210 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-b987976a-06da-43c7-824e-dabddda3862b tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/quotas/12203182731d4a61acb7fc5914aef425 HTTP/1.1" status: 200  len: 375 time: 0.0407407
May 31 16:20:26.636957 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7ab455ca-fb43-41cd-84b0-dbd17ec4a116 req-87705b46-160a-4272-89c7-225bb1ca15fd tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/security-groups?id=165e01bc-53ca-416e-93c5-98db294169b6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1198430
May 31 16:20:26.664965 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5e0fe959-cba8-4ec0-bbcb-a3f26ed9efa0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:26.674724 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:26.726604 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e0fe959-cba8-4ec0-bbcb-a3f26ed9efa0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a839e0d-09f5-4d10-804a-46c94911962c,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:26.755199 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-5e0fe959-cba8-4ec0-bbcb-a3f26ed9efa0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:26.793208 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 13d2d45a-63a0-45f1-bfe6-b2f687e752e0 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:20:26.801416 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-884c95a4-1b55-4103-bf03-13f226c8c08d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:26.803348 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-b5d25b1c-1781-4ea7-9ab5-402c82bbe22a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Synchronizing usage tracker for tenant:12203182731d4a61acb7fc5914aef425 on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:20:26.821111 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5e0fe959-cba8-4ec0-bbcb-a3f26ed9efa0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:26.824530 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-5e0fe959-cba8-4ec0-bbcb-a3f26ed9efa0 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/9a839e0d-09f5-4d10-804a-46c94911962c HTTP/1.1" status: 204  len: 168 time: 0.6562173
May 31 16:20:26.838796 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-884c95a4-1b55-4103-bf03-13f226c8c08d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:26.855819 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-b53bef65-9cf3-411b-92ee-892573689fb9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:26.893775 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8994d9f6-92ac-4499-8069-379394bb26d8 req-00207d20-0775-48c6-bcd6-1fda1c491d2f tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 210 time: 0.0641778
May 31 16:20:26.928817 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-b5d25b1c-1781-4ea7-9ab5-402c82bbe22a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Unset dirty status for tenant:12203182731d4a61acb7fc5914aef425 on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:20:26.930564 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-b5d25b1c-1781-4ea7-9ab5-402c82bbe22a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=12203182731d4a61acb7fc5914aef425&fields=id HTTP/1.1" status: 200  len: 348 time: 0.3621795
May 31 16:20:26.970823 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port 13d2d45a-63a0-45f1-bfe6-b2f687e752e0 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:20:27.003027 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 13d2d45a-63a0-45f1-bfe6-b2f687e752e0 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:20:27.003640 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:27.024629 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-884c95a4-1b55-4103-bf03-13f226c8c08d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Network d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:20:27.028646 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-884c95a4-1b55-4103-bf03-13f226c8c08d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:20:27.033828 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-884c95a4-1b55-4103-bf03-13f226c8c08d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:20:27.041779 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-884c95a4-1b55-4103-bf03-13f226c8c08d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:27.043030 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-884c95a4-1b55-4103-bf03-13f226c8c08d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:27.069034 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-884c95a4-1b55-4103-bf03-13f226c8c08d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Pushing event updated for resources: {'Port': ['ID=f99df66c-c850-4d01-80ae-3d312eee69db,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:27.075183 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-884c95a4-1b55-4103-bf03-13f226c8c08d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.63 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.3092103
May 31 16:20:27.076280 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-884c95a4-1b55-4103-bf03-13f226c8c08d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:27.090028 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Request body: {'port': {'device_id': 'b75c28e8-2e51-4a0b-b6bc-9e946d07877d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79381'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:20:27.182365 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 57408) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:27.214106 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:27.264927 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port 13d2d45a-63a0-45f1-bfe6-b2f687e752e0, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=13d2d45a-63a0-45f1-bfe6-b2f687e752e0,segment=NetworkSegment(5a3941ae-d5de-4802-8fd8-3da6c1932b05),segment_id=5a3941ae-d5de-4802-8fd8-3da6c1932b05)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:20:27.275948 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:27.285913 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:27.301457 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:27.395220 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=13d2d45a-63a0-45f1-bfe6-b2f687e752e0,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:27.396560 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-365ba25b-c140-4b79-a72c-00dc8083dd99 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:27.401149 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:27.426359 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 57412) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:27.433712 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-365ba25b-c140-4b79-a72c-00dc8083dd99 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:27.456334 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-365ba25b-c140-4b79-a72c-00dc8083dd99 admin admin] Usage tracker for resource:security_group_rule and tenant:81cd62b62c434cc98b37e751e1f2857a is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:27.462444 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-365ba25b-c140-4b79-a72c-00dc8083dd99 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:27.474908 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-365ba25b-c140-4b79-a72c-00dc8083dd99 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:27.512896 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-3bf95360-52a5-438c-99fe-2ef7736fe380 service neutron] 10.222.0.43 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5323524
May 31 16:20:27.522294 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ab0f1ef-a7e2-4bf9-b326-757c926c2390 req-d80c6055-7338-4ed9-b108-8348965ecfcf tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:27.524407 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3ab0f1ef-a7e2-4bf9-b326-757c926c2390 req-d80c6055-7338-4ed9-b108-8348965ecfcf tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 943 time: 0.3430033
May 31 16:20:27.688030 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3ab0f1ef-a7e2-4bf9-b326-757c926c2390 req-d495d6b1-7dc7-4d5e-9dba-11977bb93826 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1536484
May 31 16:20:27.789260 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-84cdd42c-d22f-4c8d-a7ff-d429ba1ad600 service neutron] 10.222.0.43 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2552259
May 31 16:20:27.792043 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f99df66c-c850-4d01-80ae-3d312eee69db {{(pid=91763) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:20:27.805416 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:27.861425 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.provisioning_blocks [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Transition to ACTIVE for port object f99df66c-c850-4d01-80ae-3d312eee69db will not be triggered until provisioned by entity L2. {{(pid=91763) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:20:27.864706 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-365ba25b-c140-4b79-a72c-00dc8083dd99 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:27.865923 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-1c43fb06-9c54-4b5a-ac4a-1f5104457308 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:27.869676 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:27.885552 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:27.937034 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 57422) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:28.010941 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-365ba25b-c140-4b79-a72c-00dc8083dd99 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:28.073498 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Pushing event updated for resources: {'Port': ['ID=f99df66c-c850-4d01-80ae-3d312eee69db,revision_number=2']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:28.080077 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:28.086801 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5766228f-9605-460f-b298-2becde0b3673 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:28.094890 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-365ba25b-c140-4b79-a72c-00dc8083dd99 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=81cd62b62c434cc98b37e751e1f2857a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9116480
May 31 16:20:28.099637 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 57436) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:28.103108 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.217s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:28.107548 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-5766228f-9605-460f-b298-2becde0b3673 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:28.110437 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-1c43fb06-9c54-4b5a-ac4a-1f5104457308 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:28.111757 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-5766228f-9605-460f-b298-2becde0b3673 admin admin] Usage tracker for resource:security_group_rule and tenant:d2d701bb01d44023afb89870354e9207 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:28.115345 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-5766228f-9605-460f-b298-2becde0b3673 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:28.128957 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-5766228f-9605-460f-b298-2becde0b3673 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:28.180525 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-1c43fb06-9c54-4b5a-ac4a-1f5104457308 admin admin] Usage tracker for resource:security_group_rule and tenant:a8035136f5d04a59bf37d03220f8afbc is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:28.214953 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-1c43fb06-9c54-4b5a-ac4a-1f5104457308 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:28.282032 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 5591c8db-5905-4285-84f7-5743de100fc2 details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:20:28.329588 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-2aa30ef7-8fb0-4160-9ca1-b15f0db61292 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:28.343127 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Attempting to bind port f99df66c-c850-4d01-80ae-3d312eee69db on host hv-cinder-79381 for vnic_type normal with profile  {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:20:28.343475 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Attempting to bind port f99df66c-c850-4d01-80ae-3d312eee69db by drivers openvswitch,hyperv on host hv-cinder-79381 at level 0 using segments [{'id': '5a3941ae-d5de-4802-8fd8-3da6c1932b05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': 'd89a2a7e-0a66-4cc2-94ab-1f50ba0056b1'}] {{(pid=91763) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:20:28.344094 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Attempting to bind port f99df66c-c850-4d01-80ae-3d312eee69db on network d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:20:28.354524 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-1c43fb06-9c54-4b5a-ac4a-1f5104457308 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:28.366759 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Port f99df66c-c850-4d01-80ae-3d312eee69db on network d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79381 {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 31 16:20:28.367081 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Attempting to bind port f99df66c-c850-4d01-80ae-3d312eee69db on network d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:20:28.371565 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5766228f-9605-460f-b298-2becde0b3673 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:28.374633 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Checking agent: {'id': '4bed2638-4d91-4afb-bf81-aacca8584621', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79381', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'started_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 20, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:20:28.374984 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Checking segment: {'id': '5a3941ae-d5de-4802-8fd8-3da6c1932b05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': 'd89a2a7e-0a66-4cc2-94ab-1f50ba0056b1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91763) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:20:28.375372 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Bound using segment: {'id': '5a3941ae-d5de-4802-8fd8-3da6c1932b05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': 'd89a2a7e-0a66-4cc2-94ab-1f50ba0056b1'} {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:20:28.375811 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Bound port: f99df66c-c850-4d01-80ae-3d312eee69db, host: hv-cinder-79381, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5a3941ae-d5de-4802-8fd8-3da6c1932b05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': 'd89a2a7e-0a66-4cc2-94ab-1f50ba0056b1'}}] {{(pid=91763) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:20:28.376161 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:28.391236 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5766228f-9605-460f-b298-2becde0b3673 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:28.400956 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-95d1ce4c-6cc0-4863-8aa4-86bdb22037c8 req-dd5db482-c78b-4454-8af7-154422ab646a tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 210 time: 0.1558874
May 31 16:20:28.403793 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-90efb0c9-2b2e-494f-912b-4be61d1f5045 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:28.424803 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-365ba25b-c140-4b79-a72c-00dc8083dd99 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=39f99f9f-a9bc-4c98-a190-60e70903617d,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:28.456055 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-365ba25b-c140-4b79-a72c-00dc8083dd99 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.376s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:28.460032 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-2aa30ef7-8fb0-4160-9ca1-b15f0db61292 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:28.477202 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 5591c8db-5905-4285-84f7-5743de100fc2, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=5591c8db-5905-4285-84f7-5743de100fc2,segment=NetworkSegment(016e9daa-b906-4ec8-978d-cb58fbcd78da),segment_id=016e9daa-b906-4ec8-978d-cb58fbcd78da)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:20:28.493841 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': '5591c8db-5905-4285-84f7-5743de100fc2', 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2', 'port_id': '5591c8db-5905-4285-84f7-5743de100fc2', 'mac_address': 'fa:16:3e:cd:18:67', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 838, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '68c4d303-4299-4977-888e-57c80b8530cc', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:20:28.497602 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-5766228f-9605-460f-b298-2becde0b3673 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=d2d701bb01d44023afb89870354e9207&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5551398
May 31 16:20:28.498675 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5766228f-9605-460f-b298-2becde0b3673 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dc487f94-a8ee-4c75-b8ca-15968ce60958,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:28.501114 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 57454) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:28.506163 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-5766228f-9605-460f-b298-2becde0b3673 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:28.565336 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] For port f99df66c-c850-4d01-80ae-3d312eee69db, host hv-cinder-79381, cleared binding levels {{(pid=91763) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:20:28.584056 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] For port f99df66c-c850-4d01-80ae-3d312eee69db, host hv-cinder-79381, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=f99df66c-c850-4d01-80ae-3d312eee69db,segment=NetworkSegment(5a3941ae-d5de-4802-8fd8-3da6c1932b05),segment_id=5a3941ae-d5de-4802-8fd8-3da6c1932b05)] {{(pid=91763) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:20:28.594264 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:28.595980 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:28.605589 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:28.621582 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5591c8db-5905-4285-84f7-5743de100fc2 {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:20:28.643486 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 5591c8db-5905-4285-84f7-5743de100fc2, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=5591c8db-5905-4285-84f7-5743de100fc2,segment=NetworkSegment(016e9daa-b906-4ec8-978d-cb58fbcd78da),segment_id=016e9daa-b906-4ec8-978d-cb58fbcd78da)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:20:28.648087 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:28.648811 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 0e5a85ae-aafa-4bae-adee-5fc58eaad298 details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:20:28.650891 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:28.654084 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2099333c-e007-446a-83c3-4b42c21d371e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:28.681862 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-795b9080-93de-48ed-9951-f03100b57844 req-fde28dbd-e349-4758-a716-65a322ad3b94 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:28.684176 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-795b9080-93de-48ed-9951-f03100b57844 req-fde28dbd-e349-4758-a716-65a322ad3b94 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.63 "GET /v2.0/networks?id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 HTTP/1.1" status: 200  len: 819 time: 0.8803351
May 31 16:20:28.690713 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:28.691325 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:28.692682 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] 10.222.0.63 "PUT /v2.0/ports/f99df66c-c850-4d01-80ae-3d312eee69db HTTP/1.1" status: 200  len: 1094 time: 1.6097357
May 31 16:20:28.695074 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b75c28e8-2e51-4a0b-b6bc-9e946d07877d', 'tag': 'f99df66c-c850-4d01-80ae-3d312eee69db'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:20:28.697653 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2293082c-16c6-4cde-b701-5c438faf54da" -d '{"events": [{"name": "network-changed", "server_uuid": "b75c28e8-2e51-4a0b-b6bc-9e946d07877d", "tag": "f99df66c-c850-4d01-80ae-3d312eee69db"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:20:28.719576 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2099333c-e007-446a-83c3-4b42c21d371e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:28.744276 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-795b9080-93de-48ed-9951-f03100b57844 req-6384438f-46f0-4ab5-b4ab-4932eaaf8aa2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Request body: {'port': {'device_id': '0d168a96-4a64-43eb-9f13-103e7383f6c0', 'network_id': 'd89a2a7e-0a66-4cc2-94ab-1f50ba0056b1', 'admin_state_up': True, 'tenant_id': '1739d3c0e2734c8a9af5c5291aac8e25'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:20:28.745827 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Pushing event updated for resources: {'Port': ['ID=f99df66c-c850-4d01-80ae-3d312eee69db,revision_number=3']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:28.750761 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:28.768473 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 13d2d45a-63a0-45f1-bfe6-b2f687e752e0 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:20:28.797911 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0353f1fb-7b00-4451-b8e0-60a02e61f39e req-20b99ffa-8fe8-471e-8d0d-958ddc36ee04 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 210 time: 0.1297100
May 31 16:20:28.806185 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44caf79e-0da4-4b5b-8ab1-54e59b2ca43f req-7a926eb6-1e72-4252-82ab-69f973a29c88 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:28.807756 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-44caf79e-0da4-4b5b-8ab1-54e59b2ca43f req-7a926eb6-1e72-4252-82ab-69f973a29c88 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 944 time: 0.9475892
May 31 16:20:28.852254 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2099333c-e007-446a-83c3-4b42c21d371e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:28.863138 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e6ce03b7-6bd2-4d3a-9639-a85fd801e9c7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:28.877507 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2099333c-e007-446a-83c3-4b42c21d371e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dc487f94-a8ee-4c75-b8ca-15968ce60958,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:28.893222 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-2099333c-e007-446a-83c3-4b42c21d371e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:28.900631 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-c7e87b27-d1c2-4c1b-9d33-3f97534f69b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:28.902232 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-c7e87b27-d1c2-4c1b-9d33-3f97534f69b4 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=1739d3c0e2734c8a9af5c5291aac8e25&device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 1097 time: 0.1362841
May 31 16:20:28.907476 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2099333c-e007-446a-83c3-4b42c21d371e admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:28.908690 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-2099333c-e007-446a-83c3-4b42c21d371e admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/dc487f94-a8ee-4c75-b8ca-15968ce60958 HTTP/1.1" status: 204  len: 168 time: 0.4046206
May 31 16:20:28.999971 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=5591c8db-5905-4285-84f7-5743de100fc2,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:29.014415 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-68d1ac19-5e13-4e41-a309-dc6a80d4b2e8 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=f99df66c-c850-4d01-80ae-3d312eee69db HTTP/1.1" status: 200  len: 217 time: 0.1043603
May 31 16:20:29.015951 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:20:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dec29158-d634-45d1-b290-33ffdb754269 x-openstack-request-id: req-dec29158-d634-45d1-b290-33ffdb754269 {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:20:29.016297 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b75c28e8-2e51-4a0b-b6bc-9e946d07877d", "tag": "f99df66c-c850-4d01-80ae-3d312eee69db", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:20:29.016570 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-dec29158-d634-45d1-b290-33ffdb754269 {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:20:29.017004 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b75c28e8-2e51-4a0b-b6bc-9e946d07877d', 'tag': 'f99df66c-c850-4d01-80ae-3d312eee69db', 'status': 'completed', 'code': 200}
May 31 16:20:29.021003 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.370s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:29.081592 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-2aa30ef7-8fb0-4160-9ca1-b15f0db61292 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:29.088751 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-44caf79e-0da4-4b5b-8ab1-54e59b2ca43f req-aa295009-b80d-426e-8921-35d9fe2b3af0 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/security-groups?id=165e01bc-53ca-416e-93c5-98db294169b6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2150304
May 31 16:20:29.123558 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-8a973d35-210f-4698-bcc2-c188440646f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:29.125007 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-8a973d35-210f-4698-bcc2-c188440646f8 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=b9c806fb-2a53-4445-8352-4336429eb043 HTTP/1.1" status: 200  len: 859 time: 0.1038866
May 31 16:20:29.134247 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-365ba25b-c140-4b79-a72c-00dc8083dd99 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:29.169296 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 0e5a85ae-aafa-4bae-adee-5fc58eaad298, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=0e5a85ae-aafa-4bae-adee-5fc58eaad298,segment=NetworkSegment(5d13bef9-5e34-4b31-8817-4dba0534b3a7),segment_id=5d13bef9-5e34-4b31-8817-4dba0534b3a7)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:20:29.190283 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 13d2d45a-63a0-45f1-bfe6-b2f687e752e0 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:20:29.190721 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:29.193546 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-0d3abd1b-9605-499c-9e36-c3c378d164d6 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0606406
May 31 16:20:29.205740 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-1c43fb06-9c54-4b5a-ac4a-1f5104457308 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:29.207007 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aa30ef7-8fb0-4160-9ca1-b15f0db61292 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=39f99f9f-a9bc-4c98-a190-60e70903617d,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:29.210218 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-2aa30ef7-8fb0-4160-9ca1-b15f0db61292 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:29.229059 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': '0e5a85ae-aafa-4bae-adee-5fc58eaad298', 'network_id': 'c99513ad-3df3-429c-a5ba-a2334e5c92fc', 'port_id': '0e5a85ae-aafa-4bae-adee-5fc58eaad298', 'mac_address': 'fa:16:3e:d5:3d:81', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 815, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd6d29986-6b64-4e75-9065-dbd87b0b7ea3', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:20:29.276842 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-795b9080-93de-48ed-9951-f03100b57844 req-6384438f-46f0-4ab5-b4ab-4932eaaf8aa2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:29.281450 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-795b9080-93de-48ed-9951-f03100b57844 req-6384438f-46f0-4ab5-b4ab-4932eaaf8aa2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Usage tracker for resource:port and tenant:1739d3c0e2734c8a9af5c5291aac8e25 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:29.284427 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-795b9080-93de-48ed-9951-f03100b57844 req-6384438f-46f0-4ab5-b4ab-4932eaaf8aa2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Quota usage for port was recalculated. Used quota:2. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:29.291394 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-795b9080-93de-48ed-9951-f03100b57844 req-6384438f-46f0-4ab5-b4ab-4932eaaf8aa2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:29.305424 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-1c43fb06-9c54-4b5a-ac4a-1f5104457308 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:29.327476 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:29.353805 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-61dacc3c-74f3-44c5-8e84-5c01c437ebaf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:29.364391 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-1c43fb06-9c54-4b5a-ac4a-1f5104457308 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=a8035136f5d04a59bf37d03220f8afbc&name=default HTTP/1.1" status: 200  len: 2979 time: 1.9341578
May 31 16:20:29.365189 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0e5a85ae-aafa-4bae-adee-5fc58eaad298 {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:20:29.365732 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-2aa30ef7-8fb0-4160-9ca1-b15f0db61292 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:29.366979 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-2aa30ef7-8fb0-4160-9ca1-b15f0db61292 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/39f99f9f-a9bc-4c98-a190-60e70903617d HTTP/1.1" status: 204  len: 168 time: 1.2500286
May 31 16:20:29.368203 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-795b9080-93de-48ed-9951-f03100b57844 req-6384438f-46f0-4ab5-b4ab-4932eaaf8aa2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Made reservation on behalf of 1739d3c0e2734c8a9af5c5291aac8e25 for: {'port': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:20:29.374253 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-795b9080-93de-48ed-9951-f03100b57844 req-6384438f-46f0-4ab5-b4ab-4932eaaf8aa2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:29.390041 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 57472) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:29.551189 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c43fb06-9c54-4b5a-ac4a-1f5104457308 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d0f65582-3692-4707-b0bb-fae39864cd0a,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:29.564303 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-802174df-6c7b-44d1-ae53-beeb8eeb0d63 service neutron] 10.222.0.63 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3635969
May 31 16:20:29.564934 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e620f99d-4a44-4da3-9c4b-8ef6e93b2b2d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:29.572501 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-1c43fb06-9c54-4b5a-ac4a-1f5104457308 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:29.602146 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e620f99d-4a44-4da3-9c4b-8ef6e93b2b2d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:29.628253 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 0e5a85ae-aafa-4bae-adee-5fc58eaad298, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=0e5a85ae-aafa-4bae-adee-5fc58eaad298,segment=NetworkSegment(5d13bef9-5e34-4b31-8817-4dba0534b3a7),segment_id=5d13bef9-5e34-4b31-8817-4dba0534b3a7)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:20:29.639489 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:29.643738 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-12ca662b-0453-433c-a772-dfcc66e15ab6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:29.652717 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb26d533-6155-4ed3-8e65-0b417794264d req-4bbd3efd-7298-4f4f-b058-e17ffdab08ff tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:29.662833 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-eb26d533-6155-4ed3-8e65-0b417794264d req-4bbd3efd-7298-4f4f-b058-e17ffdab08ff tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 944 time: 0.5103753
May 31 16:20:29.688066 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.63', 64865) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:29.868694 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=0e5a85ae-aafa-4bae-adee-5fc58eaad298,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:29.874266 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.230s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:29.944882 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['5591c8db-5905-4285-84f7-5743de100fc2'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:20:29.971207 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e620f99d-4a44-4da3-9c4b-8ef6e93b2b2d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:29.986633 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:29.997481 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [req-795b9080-93de-48ed-9951-f03100b57844 req-6384438f-46f0-4ab5-b4ab-4932eaaf8aa2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Allocated IP 172.20.0.8 (d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1/b9c806fb-2a53-4445-8352-4336429eb043/24196a14-22d0-4d09-9fa7-16d524809d92) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:20:30.009232 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e620f99d-4a44-4da3-9c4b-8ef6e93b2b2d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d0f65582-3692-4707-b0bb-fae39864cd0a,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:30.019943 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e620f99d-4a44-4da3-9c4b-8ef6e93b2b2d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:30.021282 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e620f99d-4a44-4da3-9c4b-8ef6e93b2b2d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:30.024908 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-e620f99d-4a44-4da3-9c4b-8ef6e93b2b2d admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/d0f65582-3692-4707-b0bb-fae39864cd0a HTTP/1.1" status: 204  len: 168 time: 0.6281123
May 31 16:20:30.054270 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['0e5a85ae-aafa-4bae-adee-5fc58eaad298'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:20:30.068309 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-eb26d533-6155-4ed3-8e65-0b417794264d req-13da1983-470d-4a3d-870d-179afee082e9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4040160
May 31 16:20:30.085581 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 57502) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:30.155029 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7381d08e-cfe9-4b79-8942-64a259928d2f req-29b6d4b3-cc3c-4696-9ae9-729c46d60c86 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 210 time: 0.3856175
May 31 16:20:30.165921 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-abe1267d-d77c-4f9c-9923-396c056bc2c2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:30.263448 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-8eede1fc-9ea2-4891-b2d0-c5943f0d168d req-0208fe93-3d37-4811-8bc8-a43ec194acdc service neutron] 10.222.0.63 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4670997
May 31 16:20:30.268323 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-abe1267d-d77c-4f9c-9923-396c056bc2c2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:30.280109 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-abe1267d-d77c-4f9c-9923-396c056bc2c2 admin admin] Usage tracker for resource:security_group_rule and tenant:6bea87a6c59b4b83b76bec0a51cb384f is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:30.288036 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-abe1267d-d77c-4f9c-9923-396c056bc2c2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:30.290431 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-74d95819-962e-41fa-9e06-7eabaeb190ff tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:30.297336 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-74d95819-962e-41fa-9e06-7eabaeb190ff tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.63 "GET /v2.0/networks?id=be7d7603-734f-43bb-92a8-ed07a835aeb5 HTTP/1.1" status: 200  len: 816 time: 0.6005151
May 31 16:20:30.303400 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-abe1267d-d77c-4f9c-9923-396c056bc2c2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:30.525583 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8c866a65-c9b1-4531-9548-6af3f41c67a5 req-191d879d-31c5-431a-9b75-f020892fe457 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 210 time: 0.1399429
May 31 16:20:30.626277 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2293082c-16c6-4cde-b701-5c438faf54da req-ebbd0ccf-8332-428c-af7d-0406dc9bd4a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:30.627953 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-2293082c-16c6-4cde-b701-5c438faf54da req-ebbd0ccf-8332-428c-af7d-0406dc9bd4a3 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=1739d3c0e2734c8a9af5c5291aac8e25&device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 1097 time: 0.2790563
May 31 16:20:30.640458 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-14bae28b-6bd1-4f99-9325-c7c29a7ab371 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.63 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=12203182731d4a61acb7fc5914aef425 HTTP/1.1" status: 200  len: 380 time: 0.2534006
May 31 16:20:30.658259 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-abe1267d-d77c-4f9c-9923-396c056bc2c2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:30.666235 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-abe1267d-d77c-4f9c-9923-396c056bc2c2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:30.681509 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:30.696353 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-795b9080-93de-48ed-9951-f03100b57844 req-6384438f-46f0-4ab5-b4ab-4932eaaf8aa2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:30.716192 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eab80a07-bbba-4053-9689-d5f433669270 req-fdb1809d-6b00-4a3e-b30c-c16b971035e7 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:30.723732 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-eab80a07-bbba-4053-9689-d5f433669270 req-fdb1809d-6b00-4a3e-b30c-c16b971035e7 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 945 time: 0.3443561
May 31 16:20:30.726813 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-abe1267d-d77c-4f9c-9923-396c056bc2c2 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=6bea87a6c59b4b83b76bec0a51cb384f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6256330
May 31 16:20:30.728903 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abe1267d-d77c-4f9c-9923-396c056bc2c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f92d08b1-dfa8-4e43-b452-d03382ba2481,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:30.731340 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 57528) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:30.733781 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-abe1267d-d77c-4f9c-9923-396c056bc2c2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:30.787397 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-eab80a07-bbba-4053-9689-d5f433669270 req-ecd95c2e-7d19-483a-9733-a7ef2664a1d5 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/security-groups?id=165e01bc-53ca-416e-93c5-98db294169b6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0628557
May 31 16:20:30.804680 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6536b81c-1ad3-4a72-bf3c-7fb8dcfe12c4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:30.805418 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 57532) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:30.829939 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-63bfc35c-63f7-4089-bbd7-516401ac8d6f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:30.836648 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6536b81c-1ad3-4a72-bf3c-7fb8dcfe12c4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:30.844083 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-795b9080-93de-48ed-9951-f03100b57844 req-6384438f-46f0-4ab5-b4ab-4932eaaf8aa2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:30.849210 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-63bfc35c-63f7-4089-bbd7-516401ac8d6f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:30.857108 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:30.900003 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-63bfc35c-63f7-4089-bbd7-516401ac8d6f admin admin] Usage tracker for resource:security_group_rule and tenant:fb2227e230db4311a839480064fb8f42 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:30.903035 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6536b81c-1ad3-4a72-bf3c-7fb8dcfe12c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:30.903517 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-63bfc35c-63f7-4089-bbd7-516401ac8d6f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:30.908117 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:30.929361 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-63bfc35c-63f7-4089-bbd7-516401ac8d6f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:30.931665 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6536b81c-1ad3-4a72-bf3c-7fb8dcfe12c4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f92d08b1-dfa8-4e43-b452-d03382ba2481,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:30.935292 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-6536b81c-1ad3-4a72-bf3c-7fb8dcfe12c4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:30.936275 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6536b81c-1ad3-4a72-bf3c-7fb8dcfe12c4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:30.939908 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-6536b81c-1ad3-4a72-bf3c-7fb8dcfe12c4 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/f92d08b1-dfa8-4e43-b452-d03382ba2481 HTTP/1.1" status: 204  len: 168 time: 0.2050757
May 31 16:20:30.946522 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-795b9080-93de-48ed-9951-f03100b57844 req-6384438f-46f0-4ab5-b4ab-4932eaaf8aa2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Network d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:20:30.956803 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [req-795b9080-93de-48ed-9951-f03100b57844 req-6384438f-46f0-4ab5-b4ab-4932eaaf8aa2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:20:30.966978 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [req-795b9080-93de-48ed-9951-f03100b57844 req-6384438f-46f0-4ab5-b4ab-4932eaaf8aa2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:20:30.973762 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-795b9080-93de-48ed-9951-f03100b57844 req-6384438f-46f0-4ab5-b4ab-4932eaaf8aa2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:30.974535 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-795b9080-93de-48ed-9951-f03100b57844 req-6384438f-46f0-4ab5-b4ab-4932eaaf8aa2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:31.012496 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6384438f-46f0-4ab5-b4ab-4932eaaf8aa2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Pushing event updated for resources: {'Port': ['ID=24196a14-22d0-4d09-9fa7-16d524809d92,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:31.015747 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-6384438f-46f0-4ab5-b4ab-4932eaaf8aa2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:31.030191 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-795b9080-93de-48ed-9951-f03100b57844 req-6384438f-46f0-4ab5-b4ab-4932eaaf8aa2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.63 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.2905045
May 31 16:20:31.101621 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-63bfc35c-63f7-4089-bbd7-516401ac8d6f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:31.109616 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-63bfc35c-63f7-4089-bbd7-516401ac8d6f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:31.124027 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-2aa30ef7-8fb0-4160-9ca1-b15f0db61292 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:31.202403 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-63bfc35c-63f7-4089-bbd7-516401ac8d6f admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=fb2227e230db4311a839480064fb8f42&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3929889
May 31 16:20:31.202659 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 57550) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:31.204588 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63bfc35c-63f7-4089-bbd7-516401ac8d6f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3dbd4e01-b8b0-4402-be32-15cac3f14f39,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:31.220078 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-63bfc35c-63f7-4089-bbd7-516401ac8d6f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:31.324785 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e3aafdca-e1a7-4c81-8608-038b6a838043 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:31.361939 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e3aafdca-e1a7-4c81-8608-038b6a838043 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:31.414195 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b26e8f5-b86c-4a6f-965a-45a9236503ab req-20fb8609-5d7c-45a5-8191-044a0757eb9f tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:31.415719 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8b26e8f5-b86c-4a6f-965a-45a9236503ab req-20fb8609-5d7c-45a5-8191-044a0757eb9f tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 944 time: 0.1763284
May 31 16:20:31.432430 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b05624e9-461b-437a-b077-cdee7f4845d0 req-e1b7058c-1a13-498f-88b3-e2bcabc5400f tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:31.433435 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-b05624e9-461b-437a-b077-cdee7f4845d0 req-e1b7058c-1a13-498f-88b3-e2bcabc5400f tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Synchronizing usage tracker for tenant:1739d3c0e2734c8a9af5c5291aac8e25 on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:20:31.459479 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e3aafdca-e1a7-4c81-8608-038b6a838043 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:31.466509 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:31.482645 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3aafdca-e1a7-4c81-8608-038b6a838043 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3dbd4e01-b8b0-4402-be32-15cac3f14f39,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:31.486187 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e3aafdca-e1a7-4c81-8608-038b6a838043 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:31.488220 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e3aafdca-e1a7-4c81-8608-038b6a838043 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:31.489495 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-e3aafdca-e1a7-4c81-8608-038b6a838043 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/3dbd4e01-b8b0-4402-be32-15cac3f14f39 HTTP/1.1" status: 204  len: 168 time: 0.2860959
May 31 16:20:31.490596 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8b26e8f5-b86c-4a6f-965a-45a9236503ab req-3d2fa35a-7645-429a-b20c-acd455294e30 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0665731
May 31 16:20:31.496923 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-b05624e9-461b-437a-b077-cdee7f4845d0 req-e1b7058c-1a13-498f-88b3-e2bcabc5400f tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Unset dirty status for tenant:1739d3c0e2734c8a9af5c5291aac8e25 on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:20:31.498355 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b05624e9-461b-437a-b077-cdee7f4845d0 req-e1b7058c-1a13-498f-88b3-e2bcabc5400f tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 931 time: 0.2004607
May 31 16:20:31.563243 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-b05624e9-461b-437a-b077-cdee7f4845d0 req-6a4a735f-465a-474f-89fc-2949aae9c1f3 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Synchronizing usage tracker for tenant:1739d3c0e2734c8a9af5c5291aac8e25 on resource:security_group {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:20:31.590822 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-b05624e9-461b-437a-b077-cdee7f4845d0 req-6a4a735f-465a-474f-89fc-2949aae9c1f3 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Unset dirty status for tenant:1739d3c0e2734c8a9af5c5291aac8e25 on resource:security_group {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:20:31.591976 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b05624e9-461b-437a-b077-cdee7f4845d0 req-6a4a735f-465a-474f-89fc-2949aae9c1f3 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0863311
May 31 16:20:31.718012 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-774138da-7db7-436e-b87b-1525de77714f req-96df88e5-9e02-454e-b0d7-34ee0d15ad8a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 210 time: 0.0433123
May 31 16:20:32.137881 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a400b7-1354-484e-9a65-6ae45ca10c12 req-b5d72b80-565a-4d7f-8cf9-5673ff4aea28 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:32.142279 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e8a400b7-1354-484e-9a65-6ae45ca10c12 req-b5d72b80-565a-4d7f-8cf9-5673ff4aea28 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 945 time: 0.1846151
May 31 16:20:32.190953 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e8a400b7-1354-484e-9a65-6ae45ca10c12 req-8f04f318-a6a8-4b02-a471-dae17769f9b5 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/security-groups?id=165e01bc-53ca-416e-93c5-98db294169b6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0454075
May 31 16:20:32.384457 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 57610) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:32.599435 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-cccb96d5-c168-48d0-b322-4bf251d46258 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:32.618756 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-cccb96d5-c168-48d0-b322-4bf251d46258 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:32.629500 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-cccb96d5-c168-48d0-b322-4bf251d46258 admin admin] Usage tracker for resource:security_group_rule and tenant:b14b27aa095345aabaf6a2eac77d8914 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:32.635870 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-cccb96d5-c168-48d0-b322-4bf251d46258 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:32.642713 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-cccb96d5-c168-48d0-b322-4bf251d46258 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:32.741492 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-cccb96d5-c168-48d0-b322-4bf251d46258 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:32.746652 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-cccb96d5-c168-48d0-b322-4bf251d46258 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:32.762739 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:32.791612 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-343b1dbd-873d-45eb-a697-0bb45696190f req-c8ad90e3-7267-4ecb-ac35-ee41eda7e141 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:32.794261 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-343b1dbd-873d-45eb-a697-0bb45696190f req-c8ad90e3-7267-4ecb-ac35-ee41eda7e141 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 944 time: 0.1739497
May 31 16:20:32.807342 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-cccb96d5-c168-48d0-b322-4bf251d46258 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=b14b27aa095345aabaf6a2eac77d8914&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4212658
May 31 16:20:32.808214 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cccb96d5-c168-48d0-b322-4bf251d46258 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88105589-0416-46a5-ae5e-fb7bcdcfe789,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:32.810743 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 57638) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:32.813197 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-cccb96d5-c168-48d0-b322-4bf251d46258 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:32.866628 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-343b1dbd-873d-45eb-a697-0bb45696190f req-0ae08e52-c907-4373-93d0-c6c7d7a1a42b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0604773
May 31 16:20:32.879239 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e56cfb38-47de-4fbe-adc1-8b54d75ac621 req-557c44cf-be23-419d-a147-105805b97355 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:32.888641 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e56cfb38-47de-4fbe-adc1-8b54d75ac621 req-557c44cf-be23-419d-a147-105805b97355 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 931 time: 0.1575034
May 31 16:20:32.895264 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d335bb85-63ca-4bb9-8c2a-2e5c78c7f9a1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:32.936111 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d335bb85-63ca-4bb9-8c2a-2e5c78c7f9a1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:32.937801 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e56cfb38-47de-4fbe-adc1-8b54d75ac621 req-45ec2151-839d-423f-a9bc-1ff400bbf0be tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0479953
May 31 16:20:33.012501 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d335bb85-63ca-4bb9-8c2a-2e5c78c7f9a1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:33.018614 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-cccb96d5-c168-48d0-b322-4bf251d46258 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:33.037073 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d335bb85-63ca-4bb9-8c2a-2e5c78c7f9a1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88105589-0416-46a5-ae5e-fb7bcdcfe789,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:33.042322 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d335bb85-63ca-4bb9-8c2a-2e5c78c7f9a1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:33.048812 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d335bb85-63ca-4bb9-8c2a-2e5c78c7f9a1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:33.050544 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-d335bb85-63ca-4bb9-8c2a-2e5c78c7f9a1 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/88105589-0416-46a5-ae5e-fb7bcdcfe789 HTTP/1.1" status: 204  len: 168 time: 0.2389061
May 31 16:20:33.071475 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-393e478d-9598-4984-bf17-5b58ee1aeb06 req-3bccd59d-ba3d-44c7-a48c-31ba38f0e2e2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 210 time: 0.0490808
May 31 16:20:33.231407 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Request body: {'port': {'device_id': '0d168a96-4a64-43eb-9f13-103e7383f6c0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79381'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:20:33.269706 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-ba04f386-d647-469d-8887-eea3c1145fc8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Request body: {'port': {'device_id': '236769ac-e375-4497-9fe7-7425ccc79d09', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'admin_state_up': True, 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'security_groups': ['d7103354-0273-4035-bb29-eefdd75b99c9']}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:20:33.404527 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2293082c-16c6-4cde-b701-5c438faf54da req-778b7b16-4d65-463f-a659-b965e716217d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:33.406001 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-2293082c-16c6-4cde-b701-5c438faf54da req-778b7b16-4d65-463f-a659-b965e716217d service neutron] 10.222.0.63 "GET /v2.0/networks?id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 HTTP/1.1" status: 200  len: 920 time: 0.1839504
May 31 16:20:33.490928 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-2293082c-16c6-4cde-b701-5c438faf54da req-a8a71d9e-bb7e-41cd-97ea-18d32a3559a0 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=f99df66c-c850-4d01-80ae-3d312eee69db HTTP/1.1" status: 200  len: 217 time: 0.0762594
May 31 16:20:33.560583 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:33.572990 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-ba04f386-d647-469d-8887-eea3c1145fc8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:33.602341 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2293082c-16c6-4cde-b701-5c438faf54da req-f7f327f1-eb83-4d97-a8cf-8b43784f4c71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:33.618639 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-2293082c-16c6-4cde-b701-5c438faf54da req-f7f327f1-eb83-4d97-a8cf-8b43784f4c71 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=b9c806fb-2a53-4445-8352-4336429eb043 HTTP/1.1" status: 200  len: 859 time: 0.1177297
May 31 16:20:33.634227 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-938e857a-9efb-4e4f-a3aa-909facac2359 req-9fc4521c-80eb-4340-be26-41a55d38e0a2 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:33.635740 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-938e857a-9efb-4e4f-a3aa-909facac2359 req-9fc4521c-80eb-4340-be26-41a55d38e0a2 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 945 time: 0.3173921
May 31 16:20:33.636722 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-ba04f386-d647-469d-8887-eea3c1145fc8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:33.702941 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-2293082c-16c6-4cde-b701-5c438faf54da req-db5acc79-e713-4fc1-8d1c-e327d3226bda service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0734015
May 31 16:20:33.711251 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-938e857a-9efb-4e4f-a3aa-909facac2359 req-a73f1736-37a6-4bdd-947e-f6e9e14ddbdd tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/security-groups?id=165e01bc-53ca-416e-93c5-98db294169b6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0628653
May 31 16:20:33.714041 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-ba04f386-d647-469d-8887-eea3c1145fc8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Made reservation on behalf of 12203182731d4a61acb7fc5914aef425 for: {'port': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:20:33.717359 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-ba04f386-d647-469d-8887-eea3c1145fc8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:33.722595 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 57684) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:33.750571 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-40e006d4-b26a-49be-9284-b5eb48923734 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:33.766268 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-40e006d4-b26a-49be-9284-b5eb48923734 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:33.770595 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-40e006d4-b26a-49be-9284-b5eb48923734 admin admin] Usage tracker for resource:security_group_rule and tenant:b35cc3bebcf9498c833ce1902bf309a6 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:33.774263 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-40e006d4-b26a-49be-9284-b5eb48923734 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:33.781120 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-40e006d4-b26a-49be-9284-b5eb48923734 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:33.894518 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-40e006d4-b26a-49be-9284-b5eb48923734 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:33.909853 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-40e006d4-b26a-49be-9284-b5eb48923734 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:33.936807 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:34.011383 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-40e006d4-b26a-49be-9284-b5eb48923734 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=b35cc3bebcf9498c833ce1902bf309a6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2784286
May 31 16:20:34.012425 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 57698) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:34.017145 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40e006d4-b26a-49be-9284-b5eb48923734 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4826db2e-cc10-4287-825e-dab8bd09aab4,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:34.020450 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-40e006d4-b26a-49be-9284-b5eb48923734 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:34.156151 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 57708) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:34.207546 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-ba04f386-d647-469d-8887-eea3c1145fc8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Allocated IP 172.20.0.14 (be7d7603-734f-43bb-92a8-ed07a835aeb5/eb5363fe-ee39-4adc-b299-6098caad681d/8cf870c7-bdf1-490f-adfa-61e27997bc91) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:20:34.260742 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-565af746-6a5c-4afa-8846-80367b05f097 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:34.289949 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b03a6922-40cf-4ff9-9cd6-ce6e09cbf494 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:34.305937 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-b03a6922-40cf-4ff9-9cd6-ce6e09cbf494 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:34.310230 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-b03a6922-40cf-4ff9-9cd6-ce6e09cbf494 admin admin] Usage tracker for resource:security_group_rule and tenant:c04fecd247dd4f44a2098c71a8825334 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:34.312818 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-b03a6922-40cf-4ff9-9cd6-ce6e09cbf494 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:34.318585 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-b03a6922-40cf-4ff9-9cd6-ce6e09cbf494 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:34.413822 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-565af746-6a5c-4afa-8846-80367b05f097 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:34.422137 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b03a6922-40cf-4ff9-9cd6-ce6e09cbf494 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:34.427522 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b03a6922-40cf-4ff9-9cd6-ce6e09cbf494 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:34.438008 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-c92d2774-88ad-4006-a392-f33beb0faa56 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:34.443612 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5bc45e3-1864-4e49-9d25-509f6cbb5df0 req-444c6e9d-6494-4350-9459-2cc42ecdbe34 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:34.445207 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b5bc45e3-1864-4e49-9d25-509f6cbb5df0 req-444c6e9d-6494-4350-9459-2cc42ecdbe34 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 944 time: 0.3703749
May 31 16:20:34.487478 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-b03a6922-40cf-4ff9-9cd6-ce6e09cbf494 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=c04fecd247dd4f44a2098c71a8825334&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3301945
May 31 16:20:34.488351 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b03a6922-40cf-4ff9-9cd6-ce6e09cbf494 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=24ef0efd-056b-46d6-be07-2e24a4ba2f24,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:34.490732 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 57718) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:34.493671 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-b03a6922-40cf-4ff9-9cd6-ce6e09cbf494 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:34.517474 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 24196a14-22d0-4d09-9fa7-16d524809d92 {{(pid=91764) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:20:34.556486 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:34.560506 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-da96a71f-b27e-48d4-8ff2-8af83f3121b2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:34.580441 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed82d89e-efa2-42f5-9041-e406ca356455 req-e3b897bf-9528-48e8-968c-3c83ff6be0f3 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:34.581938 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ed82d89e-efa2-42f5-9041-e406ca356455 req-e3b897bf-9528-48e8-968c-3c83ff6be0f3 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 931 time: 0.4443767
May 31 16:20:34.594686 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-da96a71f-b27e-48d4-8ff2-8af83f3121b2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:34.632516 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.provisioning_blocks [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Transition to ACTIVE for port object 24196a14-22d0-4d09-9fa7-16d524809d92 will not be triggered until provisioned by entity L2. {{(pid=91764) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:20:34.660994 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-da96a71f-b27e-48d4-8ff2-8af83f3121b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:34.667275 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:34.704316 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da96a71f-b27e-48d4-8ff2-8af83f3121b2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=24ef0efd-056b-46d6-be07-2e24a4ba2f24,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:34.708334 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-da96a71f-b27e-48d4-8ff2-8af83f3121b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:34.721549 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-da96a71f-b27e-48d4-8ff2-8af83f3121b2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:34.726383 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-da96a71f-b27e-48d4-8ff2-8af83f3121b2 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/24ef0efd-056b-46d6-be07-2e24a4ba2f24 HTTP/1.1" status: 204  len: 168 time: 0.2340701
May 31 16:20:34.744544 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:34.766892 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b5bc45e3-1864-4e49-9d25-509f6cbb5df0 req-bd14bc4c-8721-4b2d-a442-8a6862d460de tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3103018
May 31 16:20:34.776875 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 57730) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:34.797217 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:34.852924 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-2293082c-16c6-4cde-b701-5c438faf54da req-117a9cc5-fff7-4edb-a0f7-1c1b7666f42b service neutron] 10.222.0.63 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1726148
May 31 16:20:34.881593 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ed82d89e-efa2-42f5-9041-e406ca356455 req-986c43fb-8811-467d-82db-1a0fa791bafc tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2771380
May 31 16:20:35.001272 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-b5ff92e7-8fe4-455e-b2fd-f13333bd39c3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.025170 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-ba04f386-d647-469d-8887-eea3c1145fc8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.031326 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-565af746-6a5c-4afa-8846-80367b05f097 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.136856 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-56bc12f3-e987-4603-b80b-a3e75a423cae admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.139899 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Pushing event updated for resources: {'Port': ['ID=24196a14-22d0-4d09-9fa7-16d524809d92,revision_number=2']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:35.154931 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-56bc12f3-e987-4603-b80b-a3e75a423cae admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:35.158974 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-56bc12f3-e987-4603-b80b-a3e75a423cae admin admin] Usage tracker for resource:security_group_rule and tenant:3e1e4f4556cd4a84987ecf97c77a85db is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:35.162420 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-56bc12f3-e987-4603-b80b-a3e75a423cae admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:35.165464 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 57738) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:35.165864 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:20:35.169434 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.372s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:35.174617 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.075s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:35.182182 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-56bc12f3-e987-4603-b80b-a3e75a423cae admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:35.184734 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a0061259-4d4c-444f-97d2-672476babef7 req-359e1527-6d51-428f-8bcf-3e402e613639 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 210 time: 0.1645126
May 31 16:20:35.193822 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3809923f-2d5d-4c18-8483-b677b43e405f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.200977 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.provisioning_blocks [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-ba04f386-d647-469d-8887-eea3c1145fc8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Transition to ACTIVE for port object 8cf870c7-bdf1-490f-adfa-61e27997bc91 will not be triggered until provisioned by entity DHCP. {{(pid=91764) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:20:35.215865 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-565af746-6a5c-4afa-8846-80367b05f097 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4826db2e-cc10-4287-825e-dab8bd09aab4,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:35.225970 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-565af746-6a5c-4afa-8846-80367b05f097 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:35.227184 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-3809923f-2d5d-4c18-8483-b677b43e405f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:35.235633 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-3809923f-2d5d-4c18-8483-b677b43e405f admin admin] Usage tracker for resource:security_group_rule and tenant:05ebcead058e476091b8e84e01b786da is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:35.238007 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Attempting to bind port 24196a14-22d0-4d09-9fa7-16d524809d92 on host hv-cinder-79381 for vnic_type normal with profile  {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:20:35.238337 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Attempting to bind port 24196a14-22d0-4d09-9fa7-16d524809d92 by drivers openvswitch,hyperv on host hv-cinder-79381 at level 0 using segments [{'id': '5a3941ae-d5de-4802-8fd8-3da6c1932b05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': 'd89a2a7e-0a66-4cc2-94ab-1f50ba0056b1'}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:20:35.238735 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Attempting to bind port 24196a14-22d0-4d09-9fa7-16d524809d92 on network d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:20:35.244012 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-3809923f-2d5d-4c18-8483-b677b43e405f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:35.252909 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-3809923f-2d5d-4c18-8483-b677b43e405f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:35.255028 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Port 24196a14-22d0-4d09-9fa7-16d524809d92 on network d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79381 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 31 16:20:35.255346 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Attempting to bind port 24196a14-22d0-4d09-9fa7-16d524809d92 on network d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:20:35.261741 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-565af746-6a5c-4afa-8846-80367b05f097 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.262818 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-565af746-6a5c-4afa-8846-80367b05f097 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/4826db2e-cc10-4287-825e-dab8bd09aab4 HTTP/1.1" status: 204  len: 168 time: 1.2439172
May 31 16:20:35.268757 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Checking agent: {'id': '4bed2638-4d91-4afb-bf81-aacca8584621', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79381', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'started_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 20, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:20:35.269095 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Checking segment: {'id': '5a3941ae-d5de-4802-8fd8-3da6c1932b05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': 'd89a2a7e-0a66-4cc2-94ab-1f50ba0056b1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:20:35.269478 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Bound using segment: {'id': '5a3941ae-d5de-4802-8fd8-3da6c1932b05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': 'd89a2a7e-0a66-4cc2-94ab-1f50ba0056b1'} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:20:35.270026 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Bound port: 24196a14-22d0-4d09-9fa7-16d524809d92, host: hv-cinder-79381, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5a3941ae-d5de-4802-8fd8-3da6c1932b05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': 'd89a2a7e-0a66-4cc2-94ab-1f50ba0056b1'}}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:20:35.270547 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.338519 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-ba04f386-d647-469d-8887-eea3c1145fc8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.350025 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-56bc12f3-e987-4603-b80b-a3e75a423cae admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.355524 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-303a1c1e-16e3-4ebc-82cd-ec70bc6fa166 req-b66cdb4b-2b4a-4a43-85e3-d4536c922ac3 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:35.355804 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-56bc12f3-e987-4603-b80b-a3e75a423cae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.357069 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-303a1c1e-16e3-4ebc-82cd-ec70bc6fa166 req-b66cdb4b-2b4a-4a43-85e3-d4536c922ac3 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 945 time: 0.3418050
May 31 16:20:35.366352 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-55c192cf-b89a-4a67-a857-21ef421144cd service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:35.368573 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-da96a71f-b27e-48d4-8ff2-8af83f3121b2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:35.464196 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-ba04f386-d647-469d-8887-eea3c1145fc8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Network be7d7603-734f-43bb-92a8-ed07a835aeb5 is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:20:35.464632 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56bc12f3-e987-4603-b80b-a3e75a423cae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=211b53db-b642-4552-84ef-b1a8cf40f280,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:35.468964 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3809923f-2d5d-4c18-8483-b677b43e405f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.470279 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-56bc12f3-e987-4603-b80b-a3e75a423cae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:35.476060 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-56bc12f3-e987-4603-b80b-a3e75a423cae admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=3e1e4f4556cd4a84987ecf97c77a85db&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6979613
May 31 16:20:35.476904 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 57746) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:35.477037 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-ba04f386-d647-469d-8887-eea3c1145fc8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:20:35.480382 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3809923f-2d5d-4c18-8483-b677b43e405f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.487872 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-ba04f386-d647-469d-8887-eea3c1145fc8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:20:35.493733 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-ba04f386-d647-469d-8887-eea3c1145fc8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:35.494382 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-ba04f386-d647-469d-8887-eea3c1145fc8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.533784 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-303a1c1e-16e3-4ebc-82cd-ec70bc6fa166 req-daf43f22-7359-4cf6-844e-54354f0ff964 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/security-groups?id=165e01bc-53ca-416e-93c5-98db294169b6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1364264
May 31 16:20:35.534495 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba04f386-d647-469d-8887-eea3c1145fc8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Pushing event updated for resources: {'Port': ['ID=8cf870c7-bdf1-490f-adfa-61e27997bc91,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:35.541083 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-ba04f386-d647-469d-8887-eea3c1145fc8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:35.544552 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] For port 24196a14-22d0-4d09-9fa7-16d524809d92, host hv-cinder-79381, cleared binding levels {{(pid=91764) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:20:35.548528 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] For port 24196a14-22d0-4d09-9fa7-16d524809d92, host hv-cinder-79381, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=24196a14-22d0-4d09-9fa7-16d524809d92,segment=NetworkSegment(5a3941ae-d5de-4802-8fd8-3da6c1932b05),segment_id=5a3941ae-d5de-4802-8fd8-3da6c1932b05)] {{(pid=91764) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:20:35.555332 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-ba04f386-d647-469d-8887-eea3c1145fc8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.63 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 2.3281345
May 31 16:20:35.556868 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.562042 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:35.579050 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-40e006d4-b26a-49be-9284-b5eb48923734 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:35.624030 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:35.624628 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.626047 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-795b9080-93de-48ed-9951-f03100b57844 req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] 10.222.0.63 "PUT /v2.0/ports/24196a14-22d0-4d09-9fa7-16d524809d92 HTTP/1.1" status: 200  len: 1093 time: 2.4019129
May 31 16:20:35.626521 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0d168a96-4a64-43eb-9f13-103e7383f6c0', 'tag': '24196a14-22d0-4d09-9fa7-16d524809d92'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:20:35.628783 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e26e19c0-225a-4110-91e9-7798cb7203c1" -d '{"events": [{"name": "network-changed", "server_uuid": "0d168a96-4a64-43eb-9f13-103e7383f6c0", "tag": "24196a14-22d0-4d09-9fa7-16d524809d92"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:20:35.630485 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3809923f-2d5d-4c18-8483-b677b43e405f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=964352dd-78b1-425d-b9c2-d82edb491871,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:35.646109 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-3809923f-2d5d-4c18-8483-b677b43e405f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:35.656283 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Pushing event updated for resources: {'Port': ['ID=24196a14-22d0-4d09-9fa7-16d524809d92,revision_number=3']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:35.662914 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:35.694925 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:20:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ef44fd63-000c-4dcb-9812-56acee8118a8 x-openstack-request-id: req-ef44fd63-000c-4dcb-9812-56acee8118a8 {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:20:35.695240 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0d168a96-4a64-43eb-9f13-103e7383f6c0", "tag": "24196a14-22d0-4d09-9fa7-16d524809d92", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:20:35.695888 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-ef44fd63-000c-4dcb-9812-56acee8118a8 {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:20:35.696443 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0d168a96-4a64-43eb-9f13-103e7383f6c0', 'tag': '24196a14-22d0-4d09-9fa7-16d524809d92', 'status': 'completed', 'code': 200}
May 31 16:20:35.710013 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-3809923f-2d5d-4c18-8483-b677b43e405f admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=05ebcead058e476091b8e84e01b786da&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5430264
May 31 16:20:35.713019 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 57758) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:35.717435 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-c64ec301-f56f-446b-b8aa-9046c402393e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.745475 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-c64ec301-f56f-446b-b8aa-9046c402393e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.780760 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-0be81d16-c7f9-4c19-9a6a-aeb45015e50e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.815426 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-c64ec301-f56f-446b-b8aa-9046c402393e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.821645 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:35.823084 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-0be81d16-c7f9-4c19-9a6a-aeb45015e50e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.838369 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c64ec301-f56f-446b-b8aa-9046c402393e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=211b53db-b642-4552-84ef-b1a8cf40f280,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:35.840003 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-4a5c2f5b-de6b-44a3-b9cd-51aca06dab84 None None] Provisioning for port 8cf870c7-bdf1-490f-adfa-61e27997bc91 completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:20:35.845025 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-4a5c2f5b-de6b-44a3-b9cd-51aca06dab84 None None] Provisioning complete for port 8cf870c7-bdf1-490f-adfa-61e27997bc91 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:20:35.845418 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-4a5c2f5b-de6b-44a3-b9cd-51aca06dab84 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.853568 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-c64ec301-f56f-446b-b8aa-9046c402393e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:35.875835 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-c64ec301-f56f-446b-b8aa-9046c402393e admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.879697 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-c64ec301-f56f-446b-b8aa-9046c402393e admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/211b53db-b642-4552-84ef-b1a8cf40f280 HTTP/1.1" status: 204  len: 168 time: 0.4012954
May 31 16:20:35.893413 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-0be81d16-c7f9-4c19-9a6a-aeb45015e50e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.913912 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:35.926820 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-4a5c2f5b-de6b-44a3-b9cd-51aca06dab84 None None] Port 8cf870c7-bdf1-490f-adfa-61e27997bc91 cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:20:35.974498 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be81d16-c7f9-4c19-9a6a-aeb45015e50e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=964352dd-78b1-425d-b9c2-d82edb491871,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:35.977974 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-0be81d16-c7f9-4c19-9a6a-aeb45015e50e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:35.984513 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-0be81d16-c7f9-4c19-9a6a-aeb45015e50e admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:35.985981 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-0be81d16-c7f9-4c19-9a6a-aeb45015e50e admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/964352dd-78b1-425d-b9c2-d82edb491871 HTTP/1.1" status: 204  len: 168 time: 0.2721009
May 31 16:20:36.054757 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e9e96a8-2d53-4263-9d63-a4b4004ab73b req-67816eee-303d-43d4-81aa-ca85f01871f1 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:36.058373 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0e9e96a8-2d53-4263-9d63-a4b4004ab73b req-67816eee-303d-43d4-81aa-ca85f01871f1 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 944 time: 0.1446023
May 31 16:20:36.158893 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0e9e96a8-2d53-4263-9d63-a4b4004ab73b req-6d8f0a41-8730-489b-bc8b-55a4a1da1a76 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0950520
May 31 16:20:36.191778 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9cec962-7c6a-4bcf-bcf2-c6de6e84ef9d req-96cbc8a8-a4ff-4e49-b1f0-e29a793a7791 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:36.193229 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c9cec962-7c6a-4bcf-bcf2-c6de6e84ef9d req-96cbc8a8-a4ff-4e49-b1f0-e29a793a7791 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 943 time: 0.1152918
May 31 16:20:36.239957 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c9cec962-7c6a-4bcf-bcf2-c6de6e84ef9d req-a9a1e643-75e3-411a-8faa-c4edea47bd77 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0407448
May 31 16:20:36.335362 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 57786) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:36.353812 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-58cf8c7c-1a7d-4002-8cba-4e9197d107b1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:36.368404 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-58cf8c7c-1a7d-4002-8cba-4e9197d107b1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:36.372282 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-58cf8c7c-1a7d-4002-8cba-4e9197d107b1 admin admin] Usage tracker for resource:security_group_rule and tenant:e620236467c34b98b8c65a60da00bf7f is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:36.375788 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-58cf8c7c-1a7d-4002-8cba-4e9197d107b1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:36.383330 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-58cf8c7c-1a7d-4002-8cba-4e9197d107b1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:36.409085 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff571b0c-41fe-48de-91d9-ff680f6be07d req-adf63a98-29e1-4008-85c8-5e88ce3e95fa tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:36.409812 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-ff571b0c-41fe-48de-91d9-ff680f6be07d req-adf63a98-29e1-4008-85c8-5e88ce3e95fa tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Synchronizing usage tracker for tenant:12203182731d4a61acb7fc5914aef425 on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:20:36.446967 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-ff571b0c-41fe-48de-91d9-ff680f6be07d req-adf63a98-29e1-4008-85c8-5e88ce3e95fa tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Unset dirty status for tenant:12203182731d4a61acb7fc5914aef425 on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:20:36.448172 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ff571b0c-41fe-48de-91d9-ff680f6be07d req-adf63a98-29e1-4008-85c8-5e88ce3e95fa tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 932 time: 0.1400251
May 31 16:20:36.507196 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-58cf8c7c-1a7d-4002-8cba-4e9197d107b1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:36.512430 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-58cf8c7c-1a7d-4002-8cba-4e9197d107b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:36.521416 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-2099333c-e007-446a-83c3-4b42c21d371e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:36.525215 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ff571b0c-41fe-48de-91d9-ff680f6be07d req-fe3eb5b2-3d02-4e47-8578-b227a30e3f50 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0709879
May 31 16:20:36.576324 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-58cf8c7c-1a7d-4002-8cba-4e9197d107b1 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=e620236467c34b98b8c65a60da00bf7f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2397716
May 31 16:20:36.577378 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58cf8c7c-1a7d-4002-8cba-4e9197d107b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7dcf27df-41c7-4a3d-a2b7-e996da1ee33b,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:36.579071 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 57800) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:36.581204 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-58cf8c7c-1a7d-4002-8cba-4e9197d107b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:36.646033 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Request body: {'port': {'device_id': '236769ac-e375-4497-9fe7-7425ccc79d09', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79381'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:20:36.755938 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-cda6d9a3-74c9-437a-8cec-b84bcedf15c7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:36.818453 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-2293082c-16c6-4cde-b701-5c438faf54da req-52600ba3-0447-4088-9fa5-5e0fa138126a service neutron] 10.222.0.63 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1852615
May 31 16:20:36.849794 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-cda6d9a3-74c9-437a-8cec-b84bcedf15c7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:36.971773 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:37.046267 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26e19c0-225a-4110-91e9-7798cb7203c1 req-f7277b68-028f-453a-b520-35f9b9f05049 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:37.047902 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e26e19c0-225a-4110-91e9-7798cb7203c1 req-f7277b68-028f-453a-b520-35f9b9f05049 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=1739d3c0e2734c8a9af5c5291aac8e25&device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 1096 time: 0.3608577
May 31 16:20:37.068007 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be19a252-663b-4f22-8a4a-23150c0791c0 req-3ad02a84-38e8-4dd7-b53e-32cc11a3e3d8 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:37.068007 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-be19a252-663b-4f22-8a4a-23150c0791c0 req-3ad02a84-38e8-4dd7-b53e-32cc11a3e3d8 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 945 time: 0.3230264
May 31 16:20:37.107767 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-cda6d9a3-74c9-437a-8cec-b84bcedf15c7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:37.128228 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:37.215274 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cda6d9a3-74c9-437a-8cec-b84bcedf15c7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7dcf27df-41c7-4a3d-a2b7-e996da1ee33b,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:37.220925 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-cda6d9a3-74c9-437a-8cec-b84bcedf15c7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:37.248644 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 5591c8db-5905-4285-84f7-5743de100fc2 up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:20:37.382034 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning for port 5591c8db-5905-4285-84f7-5743de100fc2 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:20:37.389463 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port 5591c8db-5905-4285-84f7-5743de100fc2 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:20:37.390348 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:37.408561 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-cda6d9a3-74c9-437a-8cec-b84bcedf15c7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:37.412106 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-cda6d9a3-74c9-437a-8cec-b84bcedf15c7 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/7dcf27df-41c7-4a3d-a2b7-e996da1ee33b HTTP/1.1" status: 204  len: 168 time: 0.8296146
May 31 16:20:37.465874 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-be19a252-663b-4f22-8a4a-23150c0791c0 req-46b080c9-16d9-4623-82c1-a4dbfe0cf63c tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/security-groups?id=165e01bc-53ca-416e-93c5-98db294169b6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3694506
May 31 16:20:37.574168 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:37.578338 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26e19c0-225a-4110-91e9-7798cb7203c1 req-ebfa23ea-9965-4552-be39-3327f50bae01 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:37.579798 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e26e19c0-225a-4110-91e9-7798cb7203c1 req-ebfa23ea-9965-4552-be39-3327f50bae01 service neutron] 10.222.0.63 "GET /v2.0/networks?tenant_id=1739d3c0e2734c8a9af5c5291aac8e25&shared=False HTTP/1.1" status: 200  len: 920 time: 0.5160155
May 31 16:20:37.614822 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f08a2463-b6e4-494f-8f48-be855ffd203b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5591c8db-5905-4285-84f7-5743de100fc2'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:20:37.702046 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 5591c8db-5905-4285-84f7-5743de100fc2, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=5591c8db-5905-4285-84f7-5743de100fc2,segment=NetworkSegment(016e9daa-b906-4ec8-978d-cb58fbcd78da),segment_id=016e9daa-b906-4ec8-978d-cb58fbcd78da)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:20:37.709623 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:37.711389 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 0e5a85ae-aafa-4bae-adee-5fc58eaad298 up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:20:37.745405 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:37.842231 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=5591c8db-5905-4285-84f7-5743de100fc2,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:37.852722 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:37.873370 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning for port 0e5a85ae-aafa-4bae-adee-5fc58eaad298 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:20:37.904482 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port 0e5a85ae-aafa-4bae-adee-5fc58eaad298 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:20:37.904860 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:37.956034 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2d62558-ef1d-4814-9b5f-404fad298f20 req-19332f8d-7fbd-45ea-b96d-7c2056bde674 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:37.963511 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c2d62558-ef1d-4814-9b5f-404fad298f20 req-19332f8d-7fbd-45ea-b96d-7c2056bde674 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 944 time: 0.6123710
May 31 16:20:37.973923 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:38.121230 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c2d62558-ef1d-4814-9b5f-404fad298f20 req-f676b565-01fb-4de3-87e9-66df874e67cd tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1567662
May 31 16:20:38.134687 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26e19c0-225a-4110-91e9-7798cb7203c1 req-c6dd3a9d-14e7-4146-96dc-d4550f30fdae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:38.136127 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e26e19c0-225a-4110-91e9-7798cb7203c1 req-c6dd3a9d-14e7-4146-96dc-d4550f30fdae service neutron] 10.222.0.63 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.5082433
May 31 16:20:38.161202 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:38.180804 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57cc8924-53ba-4a64-9a68-ac7d1062d579 req-ca087ed5-41cc-4abd-85a2-8fdebdfd83e7 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:38.198552 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-57cc8924-53ba-4a64-9a68-ac7d1062d579 req-ca087ed5-41cc-4abd-85a2-8fdebdfd83e7 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 943 time: 0.4960744
May 31 16:20:38.284898 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 0e5a85ae-aafa-4bae-adee-5fc58eaad298, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=0e5a85ae-aafa-4bae-adee-5fc58eaad298,segment=NetworkSegment(5d13bef9-5e34-4b31-8817-4dba0534b3a7),segment_id=5d13bef9-5e34-4b31-8817-4dba0534b3a7)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:20:38.289357 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-79bdc8b6-b61e-408e-aa28-3aa905caafbb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:38.294716 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:38.298946 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-3b9b3660-2fa3-41dc-8875-233c4d854efe None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:38.348178 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dd6ecc5d-51f2-4b4c-91df-609b66d1f001" -d '{"events": [{"server_uuid": "f08a2463-b6e4-494f-8f48-be855ffd203b", "name": "network-vif-plugged", "status": "completed", "tag": "5591c8db-5905-4285-84f7-5743de100fc2"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:20:38.398677 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=0e5a85ae-aafa-4bae-adee-5fc58eaad298,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:38.402840 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:38.512094 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8cf870c7-bdf1-490f-adfa-61e27997bc91 {{(pid=91764) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:20:38.520659 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-57cc8924-53ba-4a64-9a68-ac7d1062d579 req-93f7c34b-78c2-4fa4-8411-5ead96938bbf tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3210118
May 31 16:20:38.528782 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:38.566070 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.provisioning_blocks [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Transition to ACTIVE for port object 8cf870c7-bdf1-490f-adfa-61e27997bc91 will not be triggered until provisioned by entity L2. {{(pid=91764) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:20:38.574269 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:38.576428 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-795b9080-93de-48ed-9951-f03100b57844 req-1644f91b-8b2a-45c0-9421-8da01fa9ee59 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:38.577948 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-795b9080-93de-48ed-9951-f03100b57844 req-1644f91b-8b2a-45c0-9421-8da01fa9ee59 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=1739d3c0e2734c8a9af5c5291aac8e25&device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 1096 time: 0.3696854
May 31 16:20:38.582777 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:38.702361 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28f93025-eaf1-48cc-a43f-6f9eb25f052d req-27f3c1e5-6ad7-4dc0-8a26-dcf043d8bc46 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:38.703934 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-28f93025-eaf1-48cc-a43f-6f9eb25f052d req-27f3c1e5-6ad7-4dc0-8a26-dcf043d8bc46 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 932 time: 0.3710871
May 31 16:20:38.733886 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-795b9080-93de-48ed-9951-f03100b57844 req-65b45c99-8359-40f2-9638-1674be10d45b service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=24196a14-22d0-4d09-9fa7-16d524809d92 HTTP/1.1" status: 200  len: 217 time: 0.1107996
May 31 16:20:38.929867 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:20:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ab0a483b-c7d5-454d-a2a4-d793f38ccc65 x-openstack-request-id: req-ab0a483b-c7d5-454d-a2a4-d793f38ccc65 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:20:38.930249 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f08a2463-b6e4-494f-8f48-be855ffd203b", "name": "network-vif-plugged", "status": "completed", "tag": "5591c8db-5905-4285-84f7-5743de100fc2", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:20:38.930522 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-ab0a483b-c7d5-454d-a2a4-d793f38ccc65 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:20:38.931094 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f08a2463-b6e4-494f-8f48-be855ffd203b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5591c8db-5905-4285-84f7-5743de100fc2', 'code': 200}
May 31 16:20:38.959343 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Pushing event updated for resources: {'Port': ['ID=8cf870c7-bdf1-490f-adfa-61e27997bc91,revision_number=2']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:38.962948 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.380s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:38.984321 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-28f93025-eaf1-48cc-a43f-6f9eb25f052d req-74e989e6-cf81-4684-8129-8a8f82991015 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2636404
May 31 16:20:38.990004 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-795b9080-93de-48ed-9951-f03100b57844 req-983b529c-01b4-4dfb-96f9-d36eda352972 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:38.992200 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-795b9080-93de-48ed-9951-f03100b57844 req-983b529c-01b4-4dfb-96f9-d36eda352972 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=b9c806fb-2a53-4445-8352-4336429eb043 HTTP/1.1" status: 200  len: 859 time: 0.1868293
May 31 16:20:39.001794 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Attempting to bind port 8cf870c7-bdf1-490f-adfa-61e27997bc91 on host hv-cinder-79381 for vnic_type normal with profile  {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:20:39.002163 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Attempting to bind port 8cf870c7-bdf1-490f-adfa-61e27997bc91 by drivers openvswitch,hyperv on host hv-cinder-79381 at level 0 using segments [{'id': '39cd3b8c-a501-4003-900e-4c3bab514801', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 806, 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5'}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:20:39.003564 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Attempting to bind port 8cf870c7-bdf1-490f-adfa-61e27997bc91 on network be7d7603-734f-43bb-92a8-ed07a835aeb5 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:20:39.074930 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Port 8cf870c7-bdf1-490f-adfa-61e27997bc91 on network be7d7603-734f-43bb-92a8-ed07a835aeb5 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79381 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 31 16:20:39.075263 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Attempting to bind port 8cf870c7-bdf1-490f-adfa-61e27997bc91 on network be7d7603-734f-43bb-92a8-ed07a835aeb5 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:20:39.079213 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-795b9080-93de-48ed-9951-f03100b57844 req-4ec70094-6fc5-4769-9a51-a7deddf2aaa6 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0797033
May 31 16:20:39.139837 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:39.142902 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Checking agent: {'id': '4bed2638-4d91-4afb-bf81-aacca8584621', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79381', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'started_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 20, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:20:39.143629 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Checking segment: {'id': '39cd3b8c-a501-4003-900e-4c3bab514801', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 806, 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:20:39.144022 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Bound using segment: {'id': '39cd3b8c-a501-4003-900e-4c3bab514801', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 806, 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5'} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:20:39.144597 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Bound port: 8cf870c7-bdf1-490f-adfa-61e27997bc91, host: hv-cinder-79381, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '39cd3b8c-a501-4003-900e-4c3bab514801', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 806, 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5'}}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:20:39.144957 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:39.269589 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device f99df66c-c850-4d01-80ae-3d312eee69db details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:20:39.350021 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e86bb67-2370-4fdd-9597-d22e0c451c0b req-266bde40-d2f4-4fa9-a37d-13f2594e3e94 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:39.352479 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-1e86bb67-2370-4fdd-9597-d22e0c451c0b req-266bde40-d2f4-4fa9-a37d-13f2594e3e94 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 1098 time: 0.1654885
May 31 16:20:39.402949 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-1e86bb67-2370-4fdd-9597-d22e0c451c0b req-16cd4d98-e2bc-4925-bb97-c12e5f7fd3ec service neutron] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:39.454589 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [req-1e86bb67-2370-4fdd-9597-d22e0c451c0b req-16cd4d98-e2bc-4925-bb97-c12e5f7fd3ec service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:39.468470 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-1e86bb67-2370-4fdd-9597-d22e0c451c0b req-16cd4d98-e2bc-4925-bb97-c12e5f7fd3ec service neutron] Usage tracker for resource:security_group_rule and tenant:6069822d9ad1473ebc837c35e08d9f89 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:39.472125 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-1e86bb67-2370-4fdd-9597-d22e0c451c0b req-16cd4d98-e2bc-4925-bb97-c12e5f7fd3ec service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:39.488532 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [req-1e86bb67-2370-4fdd-9597-d22e0c451c0b req-16cd4d98-e2bc-4925-bb97-c12e5f7fd3ec service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:39.586626 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-795b9080-93de-48ed-9951-f03100b57844 req-6e8f6663-e7e5-4bc2-b21a-c17d1a05096f service neutron] 10.222.0.63 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4939294
May 31 16:20:39.649997 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port f99df66c-c850-4d01-80ae-3d312eee69db, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=f99df66c-c850-4d01-80ae-3d312eee69db,segment=NetworkSegment(5a3941ae-d5de-4802-8fd8-3da6c1932b05),segment_id=5a3941ae-d5de-4802-8fd8-3da6c1932b05)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:20:39.720328 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-1e86bb67-2370-4fdd-9597-d22e0c451c0b req-16cd4d98-e2bc-4925-bb97-c12e5f7fd3ec service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:39.732625 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-1e86bb67-2370-4fdd-9597-d22e0c451c0b req-16cd4d98-e2bc-4925-bb97-c12e5f7fd3ec service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:39.744146 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': 'f99df66c-c850-4d01-80ae-3d312eee69db', 'network_id': 'd89a2a7e-0a66-4cc2-94ab-1f50ba0056b1', 'port_id': 'f99df66c-c850-4d01-80ae-3d312eee69db', 'mac_address': 'fa:16:3e:09:2e:b7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 824, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b9c806fb-2a53-4445-8352-4336429eb043', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:20:39.754818 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:39.800582 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-1e86bb67-2370-4fdd-9597-d22e0c451c0b req-16cd4d98-e2bc-4925-bb97-c12e5f7fd3ec service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4403913
May 31 16:20:39.825306 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:39.845697 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f99df66c-c850-4d01-80ae-3d312eee69db {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:20:39.845968 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16cd4d98-e2bc-4925-bb97-c12e5f7fd3ec service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=96435293-a37c-454c-952e-d3892019f831,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:39.853191 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-16cd4d98-e2bc-4925-bb97-c12e5f7fd3ec service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:39.880685 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port f99df66c-c850-4d01-80ae-3d312eee69db, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=f99df66c-c850-4d01-80ae-3d312eee69db,segment=NetworkSegment(5a3941ae-d5de-4802-8fd8-3da6c1932b05),segment_id=5a3941ae-d5de-4802-8fd8-3da6c1932b05)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:20:39.891993 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:39.894058 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:39.897875 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] For port 8cf870c7-bdf1-490f-adfa-61e27997bc91, host hv-cinder-79381, cleared binding levels {{(pid=91764) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:20:39.964263 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8502fb14-c2fa-4d0e-82b7-e98c92aaef4a req-ec4165c2-c4ae-47ac-9ff3-7efd43896a44 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:39.966001 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8502fb14-c2fa-4d0e-82b7-e98c92aaef4a req-ec4165c2-c4ae-47ac-9ff3-7efd43896a44 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 946 time: 0.7794409
May 31 16:20:39.970341 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-795b9080-93de-48ed-9951-f03100b57844 req-94fa88ad-ac7d-4fd4-b157-8d650589f26c service neutron] 10.222.0.63 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3736250
May 31 16:20:39.980538 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] For port 8cf870c7-bdf1-490f-adfa-61e27997bc91, host hv-cinder-79381, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=8cf870c7-bdf1-490f-adfa-61e27997bc91,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91764) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:20:40.001428 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:40.004971 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=f99df66c-c850-4d01-80ae-3d312eee69db,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:40.012998 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-ba04f386-d647-469d-8887-eea3c1145fc8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:40.035670 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:40.076730 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69be8527-933f-40ba-8640-0ca6da12b679 req-d80a2c29-a8ac-4b08-92fd-4c66d578b438 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:40.085450 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-69be8527-933f-40ba-8640-0ca6da12b679 req-d80a2c29-a8ac-4b08-92fd-4c66d578b438 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 945 time: 0.6843867
May 31 16:20:40.170561 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:40.172936 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:40.174957 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] 10.222.0.63 "PUT /v2.0/ports/8cf870c7-bdf1-490f-adfa-61e27997bc91 HTTP/1.1" status: 200  len: 1094 time: 3.5333378
May 31 16:20:40.175769 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '236769ac-e375-4497-9fe7-7425ccc79d09', 'tag': '8cf870c7-bdf1-490f-adfa-61e27997bc91'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:20:40.183907 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-61dfc9ab-972a-4c98-be4b-3de2b4a1be99" -d '{"events": [{"name": "network-changed", "server_uuid": "236769ac-e375-4497-9fe7-7425ccc79d09", "tag": "8cf870c7-bdf1-490f-adfa-61e27997bc91"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:20:40.197500 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['f99df66c-c850-4d01-80ae-3d312eee69db'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:20:40.211741 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Pushing event updated for resources: {'Port': ['ID=8cf870c7-bdf1-490f-adfa-61e27997bc91,revision_number=3']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:40.225071 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8502fb14-c2fa-4d0e-82b7-e98c92aaef4a req-f69558a6-2ae2-42f7-8f23-2e7ce7be0462 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/security-groups?id=165e01bc-53ca-416e-93c5-98db294169b6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2507837
May 31 16:20:40.226525 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.214s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:40.419684 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-69be8527-933f-40ba-8640-0ca6da12b679 req-4a5472ca-ef15-49fb-8c7d-b432515311ae tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3332136
May 31 16:20:40.526261 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-8036e04b-21db-47f6-b9ea-8ee661595288 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:40.528292 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-8036e04b-21db-47f6-b9ea-8ee661595288 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=12203182731d4a61acb7fc5914aef425&device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 1097 time: 0.3003113
May 31 16:20:40.688965 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-51e9e540-4297-4820-99e7-83e48cbeb15a service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=8cf870c7-bdf1-490f-adfa-61e27997bc91 HTTP/1.1" status: 200  len: 217 time: 0.1467004
May 31 16:20:40.782945 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7e302b3-6cec-4ab3-b0bf-71e81e8dbd21 req-2d4a7cad-fa44-481e-9de6-4f9cb3d45c28 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:40.784488 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f7e302b3-6cec-4ab3-b0bf-71e81e8dbd21 req-2d4a7cad-fa44-481e-9de6-4f9cb3d45c28 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 943 time: 0.3458138
May 31 16:20:40.818966 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-28eddeea-e3c4-49dd-8180-1c0573f87e15 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:40.821007 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-28eddeea-e3c4-49dd-8180-1c0573f87e15 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=eb5363fe-ee39-4adc-b299-6098caad681d HTTP/1.1" status: 200  len: 855 time: 0.1117477
May 31 16:20:40.842019 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:40.882243 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5c517d3-c84c-42a7-ad1a-8353c96ea5c5 req-9dda8416-67e2-4e2d-9f1c-c58f47bd424a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:40.883916 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f5c517d3-c84c-42a7-ad1a-8353c96ea5c5 req-9dda8416-67e2-4e2d-9f1c-c58f47bd424a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.2516260
May 31 16:20:40.925275 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f7e302b3-6cec-4ab3-b0bf-71e81e8dbd21 req-087633ff-ae70-489a-afcf-703740b98100 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1285720
May 31 16:20:40.931917 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1132cf94-cfb6-4b32-ae8b-ef0151475c72', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0e5a85ae-aafa-4bae-adee-5fc58eaad298'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:20:40.934717 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6d508fd5-739b-45bd-af49-770aa96a15c2" -d '{"events": [{"server_uuid": "1132cf94-cfb6-4b32-ae8b-ef0151475c72", "name": "network-vif-plugged", "status": "completed", "tag": "0e5a85ae-aafa-4bae-adee-5fc58eaad298"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:20:40.972828 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f5c517d3-c84c-42a7-ad1a-8353c96ea5c5 req-8b93d081-2c64-4ded-ba2a-4a581c5e4dc1 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0802343
May 31 16:20:40.999424 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-a1e976a6-bba7-4e86-a0e5-8462c0a314d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:41.001946 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-a1e976a6-bba7-4e86-a0e5-8462c0a314d3 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=be7d7603-734f-43bb-92a8-ed07a835aeb5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1715839
May 31 16:20:41.076427 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:20:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-15b520c1-4086-438f-87c7-3349638cfba9 x-openstack-request-id: req-15b520c1-4086-438f-87c7-3349638cfba9 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:20:41.076981 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1132cf94-cfb6-4b32-ae8b-ef0151475c72", "name": "network-vif-plugged", "status": "completed", "tag": "0e5a85ae-aafa-4bae-adee-5fc58eaad298", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:20:41.077720 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-15b520c1-4086-438f-87c7-3349638cfba9 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:20:41.078292 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1132cf94-cfb6-4b32-ae8b-ef0151475c72', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0e5a85ae-aafa-4bae-adee-5fc58eaad298', 'code': 200}
May 31 16:20:41.133898 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:20:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-97616874-17be-4f59-b197-59ce8a8d8a6d x-openstack-request-id: req-97616874-17be-4f59-b197-59ce8a8d8a6d {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:20:41.134293 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "236769ac-e375-4497-9fe7-7425ccc79d09", "tag": "8cf870c7-bdf1-490f-adfa-61e27997bc91", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:20:41.134666 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-97616874-17be-4f59-b197-59ce8a8d8a6d {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:20:41.135238 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '236769ac-e375-4497-9fe7-7425ccc79d09', 'tag': '8cf870c7-bdf1-490f-adfa-61e27997bc91', 'status': 'completed', 'code': 200}
May 31 16:20:41.188776 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 58008) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:41.248611 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-f29a2ed9-6bfe-428c-8350-718859918e9a service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2330496
May 31 16:20:41.273981 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 24196a14-22d0-4d09-9fa7-16d524809d92 details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:20:41.299466 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device f99df66c-c850-4d01-80ae-3d312eee69db up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:20:41.360705 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d9280c01-69ff-40fe-9931-3f6f91235f9f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:41.392570 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-d9280c01-69ff-40fe-9931-3f6f91235f9f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:41.401153 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-d9280c01-69ff-40fe-9931-3f6f91235f9f admin admin] Usage tracker for resource:security_group_rule and tenant:6faa455781c447f896b90f52a014a483 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:41.408467 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-d9280c01-69ff-40fe-9931-3f6f91235f9f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:41.423541 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-d9280c01-69ff-40fe-9931-3f6f91235f9f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:41.605997 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0307fa4e-f8a8-48c8-9be9-65fd8b3aa182 req-a6d90ad4-6946-4152-becd-604cbe2dfbd6 service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3458567
May 31 16:20:41.611679 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2240ddbf-3250-49e8-9d41-d208f417c44f req-7c083756-6d1b-4bef-81c4-6273c4d94f96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:41.614382 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2240ddbf-3250-49e8-9d41-d208f417c44f req-7c083756-6d1b-4bef-81c4-6273c4d94f96 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 1099 time: 0.3276613
May 31 16:20:41.622887 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning for port f99df66c-c850-4d01-80ae-3d312eee69db completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:20:41.630088 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 24196a14-22d0-4d09-9fa7-16d524809d92, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=24196a14-22d0-4d09-9fa7-16d524809d92,segment=NetworkSegment(5a3941ae-d5de-4802-8fd8-3da6c1932b05),segment_id=5a3941ae-d5de-4802-8fd8-3da6c1932b05)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:20:41.642557 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port f99df66c-c850-4d01-80ae-3d312eee69db triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:20:41.643900 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:41.654347 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d9280c01-69ff-40fe-9931-3f6f91235f9f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:41.660425 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d9280c01-69ff-40fe-9931-3f6f91235f9f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:41.674040 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-16cd4d98-e2bc-4925-bb97-c12e5f7fd3ec service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:41.693314 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': '24196a14-22d0-4d09-9fa7-16d524809d92', 'network_id': 'd89a2a7e-0a66-4cc2-94ab-1f50ba0056b1', 'port_id': '24196a14-22d0-4d09-9fa7-16d524809d92', 'mac_address': 'fa:16:3e:39:45:43', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 824, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b9c806fb-2a53-4445-8352-4336429eb043', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:20:41.730552 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-d9280c01-69ff-40fe-9931-3f6f91235f9f admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=6faa455781c447f896b90f52a014a483&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5407412
May 31 16:20:41.731600 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9280c01-69ff-40fe-9931-3f6f91235f9f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b9f37c91-dc0c-4049-8abc-358d8e4e7cbb,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:41.735622 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d9280c01-69ff-40fe-9931-3f6f91235f9f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:41.736426 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 58032) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:41.791496 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89173f14-2996-43c6-8e2a-97405dde5436 req-8a4fc626-3719-461c-b07d-9f02d709788f tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:41.793799 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-89173f14-2996-43c6-8e2a-97405dde5436 req-8a4fc626-3719-461c-b07d-9f02d709788f tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 946 time: 0.2928116
May 31 16:20:41.804970 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:41.836367 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 24196a14-22d0-4d09-9fa7-16d524809d92 {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:20:41.847629 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e58734b1-fe73-47a9-b9ae-c9805deec6ca admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:41.856606 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 24196a14-22d0-4d09-9fa7-16d524809d92, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=24196a14-22d0-4d09-9fa7-16d524809d92,segment=NetworkSegment(5a3941ae-d5de-4802-8fd8-3da6c1932b05),segment_id=5a3941ae-d5de-4802-8fd8-3da6c1932b05)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:20:41.868336 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-89173f14-2996-43c6-8e2a-97405dde5436 req-52e681f0-d9a0-4afa-9c1e-05f61016fb55 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/security-groups?id=165e01bc-53ca-416e-93c5-98db294169b6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0633764
May 31 16:20:41.898667 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e58734b1-fe73-47a9-b9ae-c9805deec6ca admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:41.900298 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96dd17eb-d15a-4c55-9891-ac8e98de23b2 req-d0722f46-82ab-49c3-b717-4d123001b77f tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:41.901896 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-96dd17eb-d15a-4c55-9891-ac8e98de23b2 req-d0722f46-82ab-49c3-b717-4d123001b77f tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 945 time: 0.2319200
May 31 16:20:41.906897 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:41.916306 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:41.994764 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-96dd17eb-d15a-4c55-9891-ac8e98de23b2 req-879b505a-51dd-447f-802f-515aa3084599 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0733130
May 31 16:20:42.019845 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e58734b1-fe73-47a9-b9ae-c9805deec6ca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:42.036479 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-6536b81c-1ad3-4a72-bf3c-7fb8dcfe12c4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:42.067746 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:42.080626 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e58734b1-fe73-47a9-b9ae-c9805deec6ca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b9f37c91-dc0c-4049-8abc-358d8e4e7cbb,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:42.086112 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e58734b1-fe73-47a9-b9ae-c9805deec6ca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:42.111560 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e58734b1-fe73-47a9-b9ae-c9805deec6ca admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:42.112953 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-e58734b1-fe73-47a9-b9ae-c9805deec6ca admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/b9f37c91-dc0c-4049-8abc-358d8e4e7cbb HTTP/1.1" status: 204  len: 168 time: 0.3749626
May 31 16:20:42.129420 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=24196a14-22d0-4d09-9fa7-16d524809d92,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:42.147075 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.231s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:42.160753 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port f99df66c-c850-4d01-80ae-3d312eee69db, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=f99df66c-c850-4d01-80ae-3d312eee69db,segment=NetworkSegment(5a3941ae-d5de-4802-8fd8-3da6c1932b05),segment_id=5a3941ae-d5de-4802-8fd8-3da6c1932b05)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:20:42.169878 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:42.174790 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-1e4c3c92-09b4-4cbc-aa87-bc0d0fc8f5ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:42.285795 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=f99df66c-c850-4d01-80ae-3d312eee69db,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:42.302179 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:42.315735 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5eabd6d-0c06-4949-a116-ad9ef172015d req-5b467268-574f-4d03-94a5-b24dcb545b95 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:42.317242 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d5eabd6d-0c06-4949-a116-ad9ef172015d req-5b467268-574f-4d03-94a5-b24dcb545b95 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 944 time: 0.1970484
May 31 16:20:42.362968 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afb3d89a-4362-4a26-b42d-112e581ce8d8 req-6dc0192f-bbc8-4786-a10a-9d75c3b5c763 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:42.370609 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-afb3d89a-4362-4a26-b42d-112e581ce8d8 req-6dc0192f-bbc8-4786-a10a-9d75c3b5c763 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.1479690
May 31 16:20:42.420065 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d5eabd6d-0c06-4949-a116-ad9ef172015d req-17d753d1-f63c-495b-928d-c322a48ca0f8 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0907187
May 31 16:20:42.446226 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-afb3d89a-4362-4a26-b42d-112e581ce8d8 req-d1c5914b-08e4-4444-be95-2cab2e383fa0 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0745690
May 31 16:20:42.624035 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 58070) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:42.756723 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1cee0055-6b32-40aa-b27b-366a08d862be admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:42.765564 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 58076) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:42.771518 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-1cee0055-6b32-40aa-b27b-366a08d862be admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:42.775378 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-1cee0055-6b32-40aa-b27b-366a08d862be admin admin] Usage tracker for resource:security_group_rule and tenant:9ce3fc21b7e34d8abfd6f1b81a199149 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:42.778287 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-1cee0055-6b32-40aa-b27b-366a08d862be admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:42.782786 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-eaf1f7d4-ccba-40c7-8b04-540574b7d406 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:42.784074 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-1cee0055-6b32-40aa-b27b-366a08d862be admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:42.798233 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-eaf1f7d4-ccba-40c7-8b04-540574b7d406 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:42.802186 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-eaf1f7d4-ccba-40c7-8b04-540574b7d406 admin admin] Usage tracker for resource:security_group_rule and tenant:2eba50ab6be54f2ea6c173bdfc874c99 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:42.806659 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-eaf1f7d4-ccba-40c7-8b04-540574b7d406 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:42.813076 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-eaf1f7d4-ccba-40c7-8b04-540574b7d406 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:42.878215 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1cee0055-6b32-40aa-b27b-366a08d862be admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:42.882043 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1cee0055-6b32-40aa-b27b-366a08d862be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:42.893560 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-56bc12f3-e987-4603-b80b-a3e75a423cae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:42.900286 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-eaf1f7d4-ccba-40c7-8b04-540574b7d406 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:42.905977 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-eaf1f7d4-ccba-40c7-8b04-540574b7d406 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:42.914836 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-b0361f64-dc0c-4fd7-b636-7172b37f0c27 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:42.936876 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-1cee0055-6b32-40aa-b27b-366a08d862be admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=9ce3fc21b7e34d8abfd6f1b81a199149&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3094668
May 31 16:20:42.937113 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 58082) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:42.940049 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cee0055-6b32-40aa-b27b-366a08d862be admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d60ab4b1-1ac8-4efd-b138-3281270f21a3,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:42.953081 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-1cee0055-6b32-40aa-b27b-366a08d862be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:42.959382 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-eaf1f7d4-ccba-40c7-8b04-540574b7d406 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=2eba50ab6be54f2ea6c173bdfc874c99&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1926575
May 31 16:20:42.960384 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaf1f7d4-ccba-40c7-8b04-540574b7d406 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b33a521f-0981-4fab-8770-7d60e81dff1f,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:42.963260 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 58086) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:42.998487 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-eaf1f7d4-ccba-40c7-8b04-540574b7d406 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:43.004123 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e87446c4-dae9-4e36-adc0-fb47a061f55a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:43.031155 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e87446c4-dae9-4e36-adc0-fb47a061f55a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:43.079288 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b75c28e8-2e51-4a0b-b6bc-9e946d07877d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f99df66c-c850-4d01-80ae-3d312eee69db'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:20:43.081780 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-174ca3f1-202e-436c-b235-5ca8b1ac3853" -d '{"events": [{"server_uuid": "b75c28e8-2e51-4a0b-b6bc-9e946d07877d", "name": "network-vif-plugged", "status": "completed", "tag": "f99df66c-c850-4d01-80ae-3d312eee69db"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:20:43.095191 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e87446c4-dae9-4e36-adc0-fb47a061f55a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:43.104296 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d335bb85-63ca-4bb9-8c2a-2e5c78c7f9a1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:43.118564 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e87446c4-dae9-4e36-adc0-fb47a061f55a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d60ab4b1-1ac8-4efd-b138-3281270f21a3,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:43.121484 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e87446c4-dae9-4e36-adc0-fb47a061f55a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:43.123982 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e87446c4-dae9-4e36-adc0-fb47a061f55a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:43.130034 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-e87446c4-dae9-4e36-adc0-fb47a061f55a admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/d60ab4b1-1ac8-4efd-b138-3281270f21a3 HTTP/1.1" status: 204  len: 168 time: 0.1917367
May 31 16:20:43.211646 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c3cff972-7734-4b34-b64a-4ae67551df13 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:43.249393 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c3cff972-7734-4b34-b64a-4ae67551df13 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:43.292643 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6769a07-358c-456f-8071-35dc510c3e93 req-28745238-8f9c-451a-a6b1-ffc8df5b9a53 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:43.294145 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f6769a07-358c-456f-8071-35dc510c3e93 req-28745238-8f9c-451a-a6b1-ffc8df5b9a53 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 946 time: 0.2920444
May 31 16:20:43.331221 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92729f78-ad29-4cb0-8692-3c2b7569be93 req-0f5e2ff2-ff79-479d-a2be-82eb22f4f117 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:43.332619 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-92729f78-ad29-4cb0-8692-3c2b7569be93 req-0f5e2ff2-ff79-479d-a2be-82eb22f4f117 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 945 time: 0.2145028
May 31 16:20:43.391854 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f6769a07-358c-456f-8071-35dc510c3e93 req-33cdbef3-bb0f-42af-a94f-f637c8c4762a tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/security-groups?id=165e01bc-53ca-416e-93c5-98db294169b6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0867729
May 31 16:20:43.405319 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-92729f78-ad29-4cb0-8692-3c2b7569be93 req-7de3521d-e694-4b6b-96d2-77e14404abdd tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0634561
May 31 16:20:43.406096 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c3cff972-7734-4b34-b64a-4ae67551df13 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:43.411169 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-0de0dd6a-511e-45fa-9d71-497b26619d63 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:43.445834 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3cff972-7734-4b34-b64a-4ae67551df13 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b33a521f-0981-4fab-8770-7d60e81dff1f,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:43.449595 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c3cff972-7734-4b34-b64a-4ae67551df13 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:43.451107 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c3cff972-7734-4b34-b64a-4ae67551df13 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:43.452852 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-c3cff972-7734-4b34-b64a-4ae67551df13 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/b33a521f-0981-4fab-8770-7d60e81dff1f HTTP/1.1" status: 204  len: 168 time: 0.4881232
May 31 16:20:43.506706 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:20:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5ff83dc2-64b3-4429-826e-e929b56bc552 x-openstack-request-id: req-5ff83dc2-64b3-4429-826e-e929b56bc552 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:20:43.507040 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b75c28e8-2e51-4a0b-b6bc-9e946d07877d", "name": "network-vif-plugged", "status": "completed", "tag": "f99df66c-c850-4d01-80ae-3d312eee69db", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:20:43.508837 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-5ff83dc2-64b3-4429-826e-e929b56bc552 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:20:43.510663 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b75c28e8-2e51-4a0b-b6bc-9e946d07877d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f99df66c-c850-4d01-80ae-3d312eee69db', 'code': 200}
May 31 16:20:43.572123 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 58112) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:43.588213 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2240ddbf-3250-49e8-9d41-d208f417c44f req-d37770ce-7afc-4967-bddf-0a5327855630 service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=165e01bc-53ca-416e-93c5-98db294169b6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1189861
May 31 16:20:43.597469 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b90cae57-24ff-47e5-9602-6e3fbab5d4f3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:43.622720 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-b90cae57-24ff-47e5-9602-6e3fbab5d4f3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:43.627941 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-b90cae57-24ff-47e5-9602-6e3fbab5d4f3 admin admin] Usage tracker for resource:security_group_rule and tenant:2a1446cc1042438e9854b70d3e4e0ec8 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:43.632070 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-b90cae57-24ff-47e5-9602-6e3fbab5d4f3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:43.640487 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-b90cae57-24ff-47e5-9602-6e3fbab5d4f3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:43.796196 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b90cae57-24ff-47e5-9602-6e3fbab5d4f3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:43.805493 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b90cae57-24ff-47e5-9602-6e3fbab5d4f3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:43.821426 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:43.843381 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d03939cb-561c-4b25-8f0d-b907e9142524 req-9fcd4adf-ec7a-46e9-a476-8d1db81c1a04 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:43.844864 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d03939cb-561c-4b25-8f0d-b907e9142524 req-9fcd4adf-ec7a-46e9-a476-8d1db81c1a04 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.1687140
May 31 16:20:43.857703 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea93183d-26ce-477c-9671-4e88ab7f292f req-72ebfca6-acde-4b39-bf0c-a484e170ce91 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:43.859177 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ea93183d-26ce-477c-9671-4e88ab7f292f req-72ebfca6-acde-4b39-bf0c-a484e170ce91 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 944 time: 0.1339984
May 31 16:20:43.888776 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b90cae57-24ff-47e5-9602-6e3fbab5d4f3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=110434d6-c64a-4afd-a1c5-7cbfe7aabe3c,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:43.893986 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-b90cae57-24ff-47e5-9602-6e3fbab5d4f3 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=2a1446cc1042438e9854b70d3e4e0ec8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3205116
May 31 16:20:43.895444 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-b90cae57-24ff-47e5-9602-6e3fbab5d4f3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:43.898901 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 58120) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:43.937332 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d03939cb-561c-4b25-8f0d-b907e9142524 req-5c0b7b26-42af-4ff1-9643-2cebf9eba7c5 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0771558
May 31 16:20:43.948147 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ea93183d-26ce-477c-9671-4e88ab7f292f req-f383becd-a590-4e67-8ece-38f73d735f64 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0746760
May 31 16:20:43.996481 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9ae53e4e-61b0-4531-81e9-c8093a3d189a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:44.040829 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9ae53e4e-61b0-4531-81e9-c8093a3d189a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:44.124523 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9ae53e4e-61b0-4531-81e9-c8093a3d189a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:44.132310 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-92ad1dbe-4a78-4cac-873f-d39da1dee09c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:44.145108 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ae53e4e-61b0-4531-81e9-c8093a3d189a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=110434d6-c64a-4afd-a1c5-7cbfe7aabe3c,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:44.159349 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-9ae53e4e-61b0-4531-81e9-c8093a3d189a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:44.168355 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9ae53e4e-61b0-4531-81e9-c8093a3d189a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:44.174012 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-9ae53e4e-61b0-4531-81e9-c8093a3d189a admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/110434d6-c64a-4afd-a1c5-7cbfe7aabe3c HTTP/1.1" status: 204  len: 168 time: 0.2697809
May 31 16:20:44.655438 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5906ea7-e4a4-4737-8478-88a36fcfd98a req-29a68e37-a464-47a8-ba22-c430f32ac1f8 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:44.665178 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e5906ea7-e4a4-4737-8478-88a36fcfd98a req-29a68e37-a464-47a8-ba22-c430f32ac1f8 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 946 time: 0.1348758
May 31 16:20:44.722342 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e5906ea7-e4a4-4737-8478-88a36fcfd98a req-957ba278-d2fc-48af-b9c3-98c080e2f590 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/security-groups?id=165e01bc-53ca-416e-93c5-98db294169b6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0559886
May 31 16:20:44.846164 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61dfc9ab-972a-4c98-be4b-3de2b4a1be99 req-8820b412-7ba4-4380-b18b-5505cf62f4ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:44.847629 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-61dfc9ab-972a-4c98-be4b-3de2b4a1be99 req-8820b412-7ba4-4380-b18b-5505cf62f4ab service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=12203182731d4a61acb7fc5914aef425&device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 1097 time: 0.0847936
May 31 16:20:44.876509 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['24196a14-22d0-4d09-9fa7-16d524809d92'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:20:45.134579 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61dfc9ab-972a-4c98-be4b-3de2b4a1be99 req-812c0f14-f31e-4afd-9a65-4f1485dcf386 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:45.136239 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-61dfc9ab-972a-4c98-be4b-3de2b4a1be99 req-812c0f14-f31e-4afd-9a65-4f1485dcf386 service neutron] 10.222.0.63 "GET /v2.0/networks?id=be7d7603-734f-43bb-92a8-ed07a835aeb5 HTTP/1.1" status: 200  len: 917 time: 0.2775519
May 31 16:20:45.320993 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-61dfc9ab-972a-4c98-be4b-3de2b4a1be99 req-0db57b60-69a5-40d2-861f-43e4f768bdfb service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=8cf870c7-bdf1-490f-adfa-61e27997bc91 HTTP/1.1" status: 200  len: 217 time: 0.1251764
May 31 16:20:45.438807 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61dfc9ab-972a-4c98-be4b-3de2b4a1be99 req-bf5bd5f7-8b5b-498b-9571-beddf5bb598f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:45.441419 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-61dfc9ab-972a-4c98-be4b-3de2b4a1be99 req-bf5bd5f7-8b5b-498b-9571-beddf5bb598f service neutron] 10.222.0.63 "GET /v2.0/subnets?id=eb5363fe-ee39-4adc-b299-6098caad681d HTTP/1.1" status: 200  len: 855 time: 0.0992250
May 31 16:20:45.457907 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76f617ca-8aa1-4bd1-ad80-2ef7150a3a45 req-841f078a-40c2-49a1-bcbc-869572a883a9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:45.459154 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-76f617ca-8aa1-4bd1-ad80-2ef7150a3a45 req-841f078a-40c2-49a1-bcbc-869572a883a9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.3216379
May 31 16:20:45.494184 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c111436-8b63-4a83-993c-f564762d43ca req-2bf49fa1-0932-49d0-ba8b-6ed842ef4db1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:45.495644 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2c111436-8b63-4a83-993c-f564762d43ca req-2bf49fa1-0932-49d0-ba8b-6ed842ef4db1 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 1099 time: 0.5878668
May 31 16:20:45.563436 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fe9f298-2376-4ab8-a953-0e57733f61da req-89706fc1-b5d2-4f50-abda-c0d3ec92d342 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:45.564949 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0fe9f298-2376-4ab8-a953-0e57733f61da req-89706fc1-b5d2-4f50-abda-c0d3ec92d342 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 944 time: 0.3681266
May 31 16:20:45.657595 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-76f617ca-8aa1-4bd1-ad80-2ef7150a3a45 req-e2a6a587-cc86-4411-97e9-2ea25e3b3ca5 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1600120
May 31 16:20:45.664000 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2c111436-8b63-4a83-993c-f564762d43ca req-87534e11-a2e9-4498-8d97-0580caf082cb service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1395135
May 31 16:20:45.674673 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0fe9f298-2376-4ab8-a953-0e57733f61da req-19d0bd2e-d5cb-403d-afa8-1140a0be8a31 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1004515
May 31 16:20:45.686372 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61dfc9ab-972a-4c98-be4b-3de2b4a1be99 req-7bd1b4fa-7cde-4c77-a3d2-4d439c0b9677 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:45.687891 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-61dfc9ab-972a-4c98-be4b-3de2b4a1be99 req-7bd1b4fa-7cde-4c77-a3d2-4d439c0b9677 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=be7d7603-734f-43bb-92a8-ed07a835aeb5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2382195
May 31 16:20:45.979741 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-61dfc9ab-972a-4c98-be4b-3de2b4a1be99 req-7661084f-2da4-4044-a795-62ffd6590c97 service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2251458
May 31 16:20:46.062980 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-071735f9-7ee3-4434-9b10-7279ad736540 req-01e9e4c2-86d3-4883-afee-3eeb58713145 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:46.073042 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-071735f9-7ee3-4434-9b10-7279ad736540 req-01e9e4c2-86d3-4883-afee-3eeb58713145 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 946 time: 0.2145240
May 31 16:20:46.316795 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-071735f9-7ee3-4434-9b10-7279ad736540 req-c502f5da-84b4-49d9-a11d-8b57806f2733 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/security-groups?id=165e01bc-53ca-416e-93c5-98db294169b6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2373838
May 31 16:20:46.377651 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-61dfc9ab-972a-4c98-be4b-3de2b4a1be99 req-0834a01c-c0fc-4ea9-8ac9-107746d5d7da service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3758879
May 31 16:20:46.944479 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35a6f5e1-9369-40df-b5fb-4c342eb9e4c5 req-e8241b88-b154-4c6b-99f6-4927037768c0 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:46.945968 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-35a6f5e1-9369-40df-b5fb-4c342eb9e4c5 req-e8241b88-b154-4c6b-99f6-4927037768c0 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 944 time: 0.1481729
May 31 16:20:46.954136 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8220d75a-6bb7-4291-9e61-9feabf4835f5 req-9b8d43d0-1f8d-44b2-832a-1bf2e8d77e9d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:46.955517 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8220d75a-6bb7-4291-9e61-9feabf4835f5 req-9b8d43d0-1f8d-44b2-832a-1bf2e8d77e9d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.1224382
May 31 16:20:47.024894 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-35a6f5e1-9369-40df-b5fb-4c342eb9e4c5 req-3057e162-d9d0-4dfc-8cbc-d01a77b1161e tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0683897
May 31 16:20:47.032587 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8220d75a-6bb7-4291-9e61-9feabf4835f5 req-cc3aa591-627a-4445-ab52-436271a21719 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0609531
May 31 16:20:47.532750 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2848373c-077e-49eb-b101-9a5819688b88 req-c3515bb9-3474-47fc-bb9c-544cba6ee9f2 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:47.534245 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2848373c-077e-49eb-b101-9a5819688b88 req-c3515bb9-3474-47fc-bb9c-544cba6ee9f2 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 946 time: 0.0962379
May 31 16:20:47.583367 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2848373c-077e-49eb-b101-9a5819688b88 req-5f0901a7-b6fc-4cc0-92fc-4964f901ca9b tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/security-groups?id=165e01bc-53ca-416e-93c5-98db294169b6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0426512
May 31 16:20:48.283504 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b9c6ffb-ffed-4fa1-9751-fc417b1ea70d req-f1c30faa-15ca-479d-97f1-41bccea67e60 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:48.284926 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1b9c6ffb-ffed-4fa1-9751-fc417b1ea70d req-f1c30faa-15ca-479d-97f1-41bccea67e60 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 944 time: 0.1447971
May 31 16:20:48.292868 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c8b80ef-6dd6-43b3-97a5-267c60cd6319 req-196df3ce-fe9d-474c-916e-9a02cd8aa5aa tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:48.294208 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8c8b80ef-6dd6-43b3-97a5-267c60cd6319 req-196df3ce-fe9d-474c-916e-9a02cd8aa5aa tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.1217163
May 31 16:20:48.365604 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1b9c6ffb-ffed-4fa1-9751-fc417b1ea70d req-f5fd01ad-436e-4745-a3cc-868523a670b4 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0703864
May 31 16:20:48.370052 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8c8b80ef-6dd6-43b3-97a5-267c60cd6319 req-ba9a321e-1a26-4efa-8060-ede82dc64d70 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0589132
May 31 16:20:48.377759 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 8cf870c7-bdf1-490f-adfa-61e27997bc91 details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:20:48.508725 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 8cf870c7-bdf1-490f-adfa-61e27997bc91, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=8cf870c7-bdf1-490f-adfa-61e27997bc91,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:20:48.521426 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': '8cf870c7-bdf1-490f-adfa-61e27997bc91', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'port_id': '8cf870c7-bdf1-490f-adfa-61e27997bc91', 'mac_address': 'fa:16:3e:b1:f3:43', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 806, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:20:48.579652 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:48.598452 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8cf870c7-bdf1-490f-adfa-61e27997bc91 {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:20:48.614216 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 8cf870c7-bdf1-490f-adfa-61e27997bc91, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=8cf870c7-bdf1-490f-adfa-61e27997bc91,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:20:48.619944 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:48.621942 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:48.689054 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=8cf870c7-bdf1-490f-adfa-61e27997bc91,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:48.692273 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:49.542065 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 24196a14-22d0-4d09-9fa7-16d524809d92 up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:20:49.612741 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7892e883-0148-4d92-a4c7-7ca947fc55b9 req-32d1c1bf-a844-47cd-b67b-c7126f0d633b tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:49.614266 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7892e883-0148-4d92-a4c7-7ca947fc55b9 req-32d1c1bf-a844-47cd-b67b-c7126f0d633b tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 944 time: 0.1429110
May 31 16:20:49.628111 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:49.634234 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning for port 24196a14-22d0-4d09-9fa7-16d524809d92 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:20:49.639085 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port 24196a14-22d0-4d09-9fa7-16d524809d92 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:20:49.639472 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:49.646125 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10812738-dc67-47a5-a3eb-7d8886bf1486 req-a404f359-b11d-41b2-9d12-9113de0c6b16 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:49.647618 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-10812738-dc67-47a5-a3eb-7d8886bf1486 req-a404f359-b11d-41b2-9d12-9113de0c6b16 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 945 time: 0.1404901
May 31 16:20:49.690532 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7892e883-0148-4d92-a4c7-7ca947fc55b9 req-10da867e-2427-4c38-bbbe-cbceaf5bbd19 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0686431
May 31 16:20:49.722205 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-10812738-dc67-47a5-a3eb-7d8886bf1486 req-6cda5789-71ec-48fd-951d-59d10e4f59ef tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0583110
May 31 16:20:49.763921 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:49.797431 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0d168a96-4a64-43eb-9f13-103e7383f6c0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '24196a14-22d0-4d09-9fa7-16d524809d92'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:20:49.799691 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-558be364-bc99-4bf5-9b29-bbdb4374bbec" -d '{"events": [{"server_uuid": "0d168a96-4a64-43eb-9f13-103e7383f6c0", "name": "network-vif-plugged", "status": "completed", "tag": "24196a14-22d0-4d09-9fa7-16d524809d92"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:20:49.808796 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 24196a14-22d0-4d09-9fa7-16d524809d92, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=24196a14-22d0-4d09-9fa7-16d524809d92,segment=NetworkSegment(5a3941ae-d5de-4802-8fd8-3da6c1932b05),segment_id=5a3941ae-d5de-4802-8fd8-3da6c1932b05)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:20:49.814008 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:49.816218 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:49.852327 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:20:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e66c3e79-5396-40a4-8776-41f0abe18e04 x-openstack-request-id: req-e66c3e79-5396-40a4-8776-41f0abe18e04 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:20:49.852703 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0d168a96-4a64-43eb-9f13-103e7383f6c0", "name": "network-vif-plugged", "status": "completed", "tag": "24196a14-22d0-4d09-9fa7-16d524809d92", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:20:49.853030 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-e66c3e79-5396-40a4-8776-41f0abe18e04 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:20:49.853490 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0d168a96-4a64-43eb-9f13-103e7383f6c0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '24196a14-22d0-4d09-9fa7-16d524809d92', 'code': 200}
May 31 16:20:49.902387 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=24196a14-22d0-4d09-9fa7-16d524809d92,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:49.905941 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:50.029081 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['8cf870c7-bdf1-490f-adfa-61e27997bc91'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:20:50.114074 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bab00af8-fe6a-4476-bd1d-0f86abad13b1 req-ae964ce4-e14d-4ec0-8745-87b587e0641e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:50.115780 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bab00af8-fe6a-4476-bd1d-0f86abad13b1 req-ae964ce4-e14d-4ec0-8745-87b587e0641e service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 1098 time: 0.0790696
May 31 16:20:50.175070 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bab00af8-fe6a-4476-bd1d-0f86abad13b1 req-d662fff9-2402-4b26-87ee-c269f76f569f service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0445123
May 31 16:20:50.958774 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8515de2-7dda-42a7-b897-e34060d164fe req-c12279b7-0ded-4e4c-a98e-ed09860800f3 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:50.960588 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b8515de2-7dda-42a7-b897-e34060d164fe req-c12279b7-0ded-4e4c-a98e-ed09860800f3 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.1502004
May 31 16:20:50.968028 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-582d9241-dbcf-4c3c-9972-90c1217ab973 req-15e8ef6f-ee18-47f5-bbd7-65f067a31c42 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:50.969393 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-582d9241-dbcf-4c3c-9972-90c1217ab973 req-15e8ef6f-ee18-47f5-bbd7-65f067a31c42 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 945 time: 0.1248820
May 31 16:20:51.039999 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b8515de2-7dda-42a7-b897-e34060d164fe req-10ef3066-1f99-4c96-9081-660790dd009c tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0696242
May 31 16:20:51.049668 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-582d9241-dbcf-4c3c-9972-90c1217ab973 req-c2c9ddf3-dd45-4c9a-b117-9afacf9b01fa tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0639780
May 31 16:20:51.565822 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 8cf870c7-bdf1-490f-adfa-61e27997bc91 up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:20:51.644588 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning for port 8cf870c7-bdf1-490f-adfa-61e27997bc91 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:20:51.649456 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port 8cf870c7-bdf1-490f-adfa-61e27997bc91 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:20:51.650051 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:51.738942 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 58384) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:51.776005 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:51.827635 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 8cf870c7-bdf1-490f-adfa-61e27997bc91, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=8cf870c7-bdf1-490f-adfa-61e27997bc91,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:20:51.833210 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:51.835278 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:51.890997 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9115a6a6-8344-4a14-b933-002129b6af31 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:51.923075 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-9115a6a6-8344-4a14-b933-002129b6af31 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:51.934615 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-9115a6a6-8344-4a14-b933-002129b6af31 admin admin] Usage tracker for resource:security_group_rule and tenant:b4fba7ef77a14c53a8ca3cdc2561e9f4 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:51.942653 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-9115a6a6-8344-4a14-b933-002129b6af31 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:51.947906 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '236769ac-e375-4497-9fe7-7425ccc79d09', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8cf870c7-bdf1-490f-adfa-61e27997bc91'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:20:51.950172 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5c69c2f6-1ccf-461d-9ac1-ac1b431c6deb" -d '{"events": [{"server_uuid": "236769ac-e375-4497-9fe7-7425ccc79d09", "name": "network-vif-plugged", "status": "completed", "tag": "8cf870c7-bdf1-490f-adfa-61e27997bc91"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:20:51.952663 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=8cf870c7-bdf1-490f-adfa-61e27997bc91,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:51.955727 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:51.960389 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-9115a6a6-8344-4a14-b933-002129b6af31 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:52.000939 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:20:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c4ba21da-0feb-454e-8192-e77b02d32a8a x-openstack-request-id: req-c4ba21da-0feb-454e-8192-e77b02d32a8a {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:20:52.001460 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "236769ac-e375-4497-9fe7-7425ccc79d09", "name": "network-vif-plugged", "status": "completed", "tag": "8cf870c7-bdf1-490f-adfa-61e27997bc91", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:20:52.002010 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-c4ba21da-0feb-454e-8192-e77b02d32a8a {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:20:52.002710 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '236769ac-e375-4497-9fe7-7425ccc79d09', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8cf870c7-bdf1-490f-adfa-61e27997bc91', 'code': 200}
May 31 16:20:52.102508 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9115a6a6-8344-4a14-b933-002129b6af31 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:52.107035 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9115a6a6-8344-4a14-b933-002129b6af31 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:52.120287 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-b03a6922-40cf-4ff9-9cd6-ce6e09cbf494 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:52.174631 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-9115a6a6-8344-4a14-b933-002129b6af31 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=b4fba7ef77a14c53a8ca3cdc2561e9f4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4345479
May 31 16:20:52.175823 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9115a6a6-8344-4a14-b933-002129b6af31 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=15bd8c99-b41c-4cef-bbf8-0c1640b079f1,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:52.177420 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 58416) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:52.194526 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-9115a6a6-8344-4a14-b933-002129b6af31 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:52.355703 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-a707ea85-90a5-44e3-94d3-2b862e3e0909 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:52.407129 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-a707ea85-90a5-44e3-94d3-2b862e3e0909 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:52.479767 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9daecdf9-22f6-4e7e-b0f8-8c358a8a1831 req-46eb646c-9beb-4dc5-a7e5-a83cb4098de3 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:52.481230 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9daecdf9-22f6-4e7e-b0f8-8c358a8a1831 req-46eb646c-9beb-4dc5-a7e5-a83cb4098de3 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.2315805
May 31 16:20:52.491865 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cec65fd-b1d2-4ced-a1e6-7ac14292ae14 req-e27a814a-2886-4e45-a2a7-0af1921a2c9b tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:52.493515 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8cec65fd-b1d2-4ced-a1e6-7ac14292ae14 req-e27a814a-2886-4e45-a2a7-0af1921a2c9b tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.2033143
May 31 16:20:52.564602 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-a707ea85-90a5-44e3-94d3-2b862e3e0909 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:52.573991 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c3863eb0-d7f2-4231-a343-7aff37c67aa0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:52.588109 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9daecdf9-22f6-4e7e-b0f8-8c358a8a1831 req-ad6b6d8e-c273-4cb2-b264-c3a55d681163 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0932643
May 31 16:20:52.594788 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a707ea85-90a5-44e3-94d3-2b862e3e0909 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=15bd8c99-b41c-4cef-bbf8-0c1640b079f1,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:52.599651 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-a707ea85-90a5-44e3-94d3-2b862e3e0909 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:52.602919 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8cec65fd-b1d2-4ced-a1e6-7ac14292ae14 req-8b6db6f0-a776-4c74-adca-18f1fd9240ed tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0918298
May 31 16:20:52.605024 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-a707ea85-90a5-44e3-94d3-2b862e3e0909 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:52.606066 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-a707ea85-90a5-44e3-94d3-2b862e3e0909 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/15bd8c99-b41c-4cef-bbf8-0c1640b079f1 HTTP/1.1" status: 204  len: 168 time: 0.4275310
May 31 16:20:52.692738 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 58436) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:52.950823 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-651066d9-c627-493e-b99a-4132aa44018b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:52.966934 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-651066d9-c627-493e-b99a-4132aa44018b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:53.006144 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-651066d9-c627-493e-b99a-4132aa44018b admin admin] Usage tracker for resource:security_group_rule and tenant:3afbe161cb5f4610899fedcd170a27ce is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:53.016539 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-651066d9-c627-493e-b99a-4132aa44018b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:53.024484 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-651066d9-c627-493e-b99a-4132aa44018b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:53.088406 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe28ec0-d2e9-4636-b4a4-2268e7c58b64 req-853c9622-128f-4811-b75b-f32878e9b12e tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:53.089942 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cbe28ec0-d2e9-4636-b4a4-2268e7c58b64 req-853c9622-128f-4811-b75b-f32878e9b12e tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.1246443
May 31 16:20:53.170441 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cbe28ec0-d2e9-4636-b4a4-2268e7c58b64 req-a1e93cf5-bc38-4446-b230-0e7ce9365d85 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0707111
May 31 16:20:53.177613 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-651066d9-c627-493e-b99a-4132aa44018b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:53.189769 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-651066d9-c627-493e-b99a-4132aa44018b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:53.194052 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-30bf31ef-0778-44ad-bbb6-0b82c635b781 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:53.236523 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-651066d9-c627-493e-b99a-4132aa44018b admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=3afbe161cb5f4610899fedcd170a27ce&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5418749
May 31 16:20:53.237642 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-651066d9-c627-493e-b99a-4132aa44018b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0ec4fc7d-de34-4d44-9504-7c6be65dd20c,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:53.242843 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 58460) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:53.243425 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-651066d9-c627-493e-b99a-4132aa44018b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:53.304341 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-30513076-3a71-4fa5-938b-1044cb69a083 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:53.331091 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-30513076-3a71-4fa5-938b-1044cb69a083 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:53.390842 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-30513076-3a71-4fa5-938b-1044cb69a083 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:53.397938 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-9115a6a6-8344-4a14-b933-002129b6af31 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:53.411267 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30513076-3a71-4fa5-938b-1044cb69a083 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ec4fc7d-de34-4d44-9504-7c6be65dd20c,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:53.414975 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-30513076-3a71-4fa5-938b-1044cb69a083 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:53.425880 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-30513076-3a71-4fa5-938b-1044cb69a083 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:53.429493 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-30513076-3a71-4fa5-938b-1044cb69a083 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/0ec4fc7d-de34-4d44-9504-7c6be65dd20c HTTP/1.1" status: 204  len: 168 time: 0.1891329
May 31 16:20:53.827634 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 58486) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:53.846209 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-a9188209-9449-437d-b134-622846bbc869 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:53.861659 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-a9188209-9449-437d-b134-622846bbc869 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:53.863346 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f23207d-048c-4d27-b1a5-5bc97473004c req-e589248a-8445-464c-afcf-3598479793ef tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:53.864825 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4f23207d-048c-4d27-b1a5-5bc97473004c req-e589248a-8445-464c-afcf-3598479793ef tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.1514356
May 31 16:20:53.865933 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-a9188209-9449-437d-b134-622846bbc869 admin admin] Usage tracker for resource:security_group_rule and tenant:14df49898def4ffaab003c0f616d2576 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:53.869355 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-a9188209-9449-437d-b134-622846bbc869 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:53.876151 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-a9188209-9449-437d-b134-622846bbc869 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:53.921316 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4f23207d-048c-4d27-b1a5-5bc97473004c req-276a31ae-94cc-4515-9fd4-5f7ea9e2a0b6 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0491180
May 31 16:20:53.984056 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-a9188209-9449-437d-b134-622846bbc869 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:53.988270 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-a9188209-9449-437d-b134-622846bbc869 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:53.997813 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-c64ec301-f56f-446b-b8aa-9046c402393e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:54.043552 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9188209-9449-437d-b134-622846bbc869 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=61c312e5-049e-4ab0-87e7-68104cdf55d8,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:54.047049 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-a9188209-9449-437d-b134-622846bbc869 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:54.049369 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-a9188209-9449-437d-b134-622846bbc869 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=14df49898def4ffaab003c0f616d2576&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2206056
May 31 16:20:54.052020 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 58494) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:54.109773 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-381679ab-b0fa-468b-9bc5-006addabaf10 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:54.138506 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-381679ab-b0fa-468b-9bc5-006addabaf10 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:54.191076 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-381679ab-b0fa-468b-9bc5-006addabaf10 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:54.196344 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e620f99d-4a44-4da3-9c4b-8ef6e93b2b2d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:54.209857 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-381679ab-b0fa-468b-9bc5-006addabaf10 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=61c312e5-049e-4ab0-87e7-68104cdf55d8,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:54.212131 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-381679ab-b0fa-468b-9bc5-006addabaf10 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:54.213699 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-381679ab-b0fa-468b-9bc5-006addabaf10 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/61c312e5-049e-4ab0-87e7-68104cdf55d8 HTTP/1.1" status: 204  len: 168 time: 0.1603110
May 31 16:20:54.214142 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-381679ab-b0fa-468b-9bc5-006addabaf10 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:54.385747 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfd652dd-2232-4ce3-ba90-7e7d187ac853 req-68e57a79-cb6b-49e4-aae5-24d527d900c8 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:54.387218 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cfd652dd-2232-4ce3-ba90-7e7d187ac853 req-68e57a79-cb6b-49e4-aae5-24d527d900c8 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.0806613
May 31 16:20:54.436983 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cfd652dd-2232-4ce3-ba90-7e7d187ac853 req-561d2c40-2038-4db5-82de-2ed18d39d3b1 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433784
May 31 16:20:55.022347 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0b59375-2f52-4798-8598-fccd7325f5b4 req-cd1b87d7-90fd-415d-a311-a79a3583b981 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:55.023812 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a0b59375-2f52-4798-8598-fccd7325f5b4 req-cd1b87d7-90fd-415d-a311-a79a3583b981 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=1739d3c0e2734c8a9af5c5291aac8e25&device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 1098 time: 0.1165383
May 31 16:20:55.328426 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76e232f0-25f3-4bea-917c-2044462fd2d4 req-aaa48d2a-e793-4f5a-a0bf-0a0e5176fa97 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:55.329962 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-76e232f0-25f3-4bea-917c-2044462fd2d4 req-aaa48d2a-e793-4f5a-a0bf-0a0e5176fa97 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.2832282
May 31 16:20:55.335005 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0b59375-2f52-4798-8598-fccd7325f5b4 req-d553737c-180c-4801-8d22-4d2336395a90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:55.336395 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a0b59375-2f52-4798-8598-fccd7325f5b4 req-d553737c-180c-4801-8d22-4d2336395a90 service neutron] 10.222.0.63 "GET /v2.0/networks?id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 HTTP/1.1" status: 200  len: 920 time: 0.2465777
May 31 16:20:55.339094 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cec7a0ce-9913-4a96-b6d5-8261b5628373 req-2fcf9f60-904b-4e59-953a-7366e32519d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:55.340458 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cec7a0ce-9913-4a96-b6d5-8261b5628373 req-2fcf9f60-904b-4e59-953a-7366e32519d5 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 1099 time: 0.2486081
May 31 16:20:55.428732 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 58544) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:55.451819 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a0b59375-2f52-4798-8598-fccd7325f5b4 req-a2054ca1-9cb0-49bd-8231-44fb4b0611fb service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=24196a14-22d0-4d09-9fa7-16d524809d92 HTTP/1.1" status: 200  len: 217 time: 0.0954888
May 31 16:20:55.526163 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-76e232f0-25f3-4bea-917c-2044462fd2d4 req-691d3988-40f0-4b82-ac77-3df687ddc60d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1847422
May 31 16:20:55.535827 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cec7a0ce-9913-4a96-b6d5-8261b5628373 req-68c5e7a7-3d42-4c2e-bb77-85666e02baac service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1806033
May 31 16:20:55.551590 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0b59375-2f52-4798-8598-fccd7325f5b4 req-e779b35f-759d-473d-a026-4f0cfd615607 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:55.553834 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a0b59375-2f52-4798-8598-fccd7325f5b4 req-e779b35f-759d-473d-a026-4f0cfd615607 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=b9c806fb-2a53-4445-8352-4336429eb043 HTTP/1.1" status: 200  len: 859 time: 0.0864081
May 31 16:20:55.562252 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:55.577288 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:55.581138 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Usage tracker for resource:security_group_rule and tenant:a9d024d276d145478047505a36ea4847 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:55.584716 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:55.590674 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:55.656447 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a0b59375-2f52-4798-8598-fccd7325f5b4 req-e52879ff-51da-4af6-96cf-5eea8af956c6 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0532334
May 31 16:20:55.688529 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:55.694324 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:55.704765 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-9ae53e4e-61b0-4531-81e9-c8093a3d189a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:55.757592 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=a9d024d276d145478047505a36ea4847&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3248460
May 31 16:20:55.757592 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb834155-ed52-4490-9b0a-6e2dda82ad71,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:55.758942 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 58566) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:55.780429 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:55.780908 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:55.789451 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:55.789895 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:55.790231 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:55.790584 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:55.790927 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:55.791272 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:55.791601 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:55.791939 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:55.792271 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:55.792601 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:55.798267 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:55.799186 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae099aae-a911-4d1f-aab2-d1485609bf44 req-6773c703-f8a5-4270-a47e-55b2b40b8fba tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:55.800677 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ae099aae-a911-4d1f-aab2-d1485609bf44 req-6773c703-f8a5-4270-a47e-55b2b40b8fba tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.2361319
May 31 16:20:55.838809 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a0b59375-2f52-4798-8598-fccd7325f5b4 req-ce9bfed4-1fa0-44a0-b81b-b6874c55496d service neutron] 10.222.0.63 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1710274
May 31 16:20:55.850300 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-54c693f8-178e-4c3b-bfb7-ab49fda04245 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:55.893827 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-54c693f8-178e-4c3b-bfb7-ab49fda04245 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:55.954560 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ae099aae-a911-4d1f-aab2-d1485609bf44 req-9977967b-d2ea-4f20-81d4-bb9ac8d2ff19 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1365504
May 31 16:20:55.972005 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-54c693f8-178e-4c3b-bfb7-ab49fda04245 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:55.981966 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-381679ab-b0fa-468b-9bc5-006addabaf10 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:55.997241 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54c693f8-178e-4c3b-bfb7-ab49fda04245 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb834155-ed52-4490-9b0a-6e2dda82ad71,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:56.000931 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-54c693f8-178e-4c3b-bfb7-ab49fda04245 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:56.005263 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-54c693f8-178e-4c3b-bfb7-ab49fda04245 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:56.007517 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-54c693f8-178e-4c3b-bfb7-ab49fda04245 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/fb834155-ed52-4490-9b0a-6e2dda82ad71 HTTP/1.1" status: 204  len: 168 time: 0.2476606
May 31 16:20:56.057630 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a0b59375-2f52-4798-8598-fccd7325f5b4 req-23e4b318-4ca6-4554-8d15-ffee96b48fec service neutron] 10.222.0.63 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2073643
May 31 16:20:56.717656 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 58624) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:56.770311 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efdca99e-7306-4aa7-949f-52bbccd735e6 req-e61aeda6-c6a1-4025-a984-dfe94330cf75 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:56.776458 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-efdca99e-7306-4aa7-949f-52bbccd735e6 req-e61aeda6-c6a1-4025-a984-dfe94330cf75 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.1098261
May 31 16:20:56.835991 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-efdca99e-7306-4aa7-949f-52bbccd735e6 req-2442d30c-4ad7-44e6-b92e-86a0f8c82e53 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0533166
May 31 16:20:56.894573 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ab5b5f6f-df7a-4479-9dbc-4cb126e6e0b3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:56.913804 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-ab5b5f6f-df7a-4479-9dbc-4cb126e6e0b3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:56.917823 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-ab5b5f6f-df7a-4479-9dbc-4cb126e6e0b3 admin admin] Usage tracker for resource:security_group_rule and tenant:5641c6ecc7654dcfbd43bb412032bcc9 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:56.920773 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-ab5b5f6f-df7a-4479-9dbc-4cb126e6e0b3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:56.926780 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-ab5b5f6f-df7a-4479-9dbc-4cb126e6e0b3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:57.016248 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ab5b5f6f-df7a-4479-9dbc-4cb126e6e0b3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:57.020593 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ab5b5f6f-df7a-4479-9dbc-4cb126e6e0b3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:57.031019 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-abe1267d-d77c-4f9c-9923-396c056bc2c2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:57.081244 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 58646) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:57.081444 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-ab5b5f6f-df7a-4479-9dbc-4cb126e6e0b3 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=5641c6ecc7654dcfbd43bb412032bcc9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3627446
May 31 16:20:57.082241 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab5b5f6f-df7a-4479-9dbc-4cb126e6e0b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0274c2d4-e530-408e-9390-0c8f013135fd,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:57.086135 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-ab5b5f6f-df7a-4479-9dbc-4cb126e6e0b3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:57.209705 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c32883b4-e737-45c6-a258-d00ed28c1188 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:57.242125 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c32883b4-e737-45c6-a258-d00ed28c1188 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:57.259044 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98834860-070c-467c-9721-01e6d29ad97f req-be566e7f-52bc-4a98-bd22-09cecae4de23 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:57.260548 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-98834860-070c-467c-9721-01e6d29ad97f req-be566e7f-52bc-4a98-bd22-09cecae4de23 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.1588364
May 31 16:20:57.335921 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-98834860-070c-467c-9721-01e6d29ad97f req-25ea44c8-af50-41a0-bc99-3e7d40a47e81 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0630529
May 31 16:20:57.352370 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c32883b4-e737-45c6-a258-d00ed28c1188 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:57.357308 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-e9f257fb-4ae3-41c4-960c-a6bf47046772 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:57.371316 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c32883b4-e737-45c6-a258-d00ed28c1188 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0274c2d4-e530-408e-9390-0c8f013135fd,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:57.382084 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32883b4-e737-45c6-a258-d00ed28c1188 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:57.382448 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32883b4-e737-45c6-a258-d00ed28c1188 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:57.382796 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32883b4-e737-45c6-a258-d00ed28c1188 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:57.383144 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32883b4-e737-45c6-a258-d00ed28c1188 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:57.383486 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32883b4-e737-45c6-a258-d00ed28c1188 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:57.383819 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32883b4-e737-45c6-a258-d00ed28c1188 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:57.384200 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32883b4-e737-45c6-a258-d00ed28c1188 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:57.384487 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32883b4-e737-45c6-a258-d00ed28c1188 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:57.384818 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32883b4-e737-45c6-a258-d00ed28c1188 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:57.385145 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32883b4-e737-45c6-a258-d00ed28c1188 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:57.385475 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32883b4-e737-45c6-a258-d00ed28c1188 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:57.385835 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32883b4-e737-45c6-a258-d00ed28c1188 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:20:57.389239 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c32883b4-e737-45c6-a258-d00ed28c1188 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:57.390721 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c32883b4-e737-45c6-a258-d00ed28c1188 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:57.391939 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-c32883b4-e737-45c6-a258-d00ed28c1188 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/0274c2d4-e530-408e-9390-0c8f013135fd HTTP/1.1" status: 204  len: 168 time: 0.3088682
May 31 16:20:57.764542 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 58666) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:57.824837 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2e963c72-d971-40a7-9dc5-3d957a67c90a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:57.839861 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-2e963c72-d971-40a7-9dc5-3d957a67c90a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:57.843673 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-2e963c72-d971-40a7-9dc5-3d957a67c90a admin admin] Usage tracker for resource:security_group_rule and tenant:1290fdaae3b74117a53707a717f46da8 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:57.846477 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-2e963c72-d971-40a7-9dc5-3d957a67c90a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:57.852702 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-2e963c72-d971-40a7-9dc5-3d957a67c90a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:57.937766 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2e963c72-d971-40a7-9dc5-3d957a67c90a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:57.941516 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2e963c72-d971-40a7-9dc5-3d957a67c90a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:57.949904 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-1cee0055-6b32-40aa-b27b-366a08d862be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:57.993306 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-2e963c72-d971-40a7-9dc5-3d957a67c90a admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=1290fdaae3b74117a53707a717f46da8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2276995
May 31 16:20:57.994684 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e963c72-d971-40a7-9dc5-3d957a67c90a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e8b8f6fe-3a4d-4df4-9c5b-4e5aae937ca3,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:57.998720 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-2e963c72-d971-40a7-9dc5-3d957a67c90a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:57.999655 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 58674) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:58.062120 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62f75a48-af5e-490f-b025-8353525efb0e req-c9e03047-e297-40f6-9177-86c2e664d560 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:58.063709 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-62f75a48-af5e-490f-b025-8353525efb0e req-c9e03047-e297-40f6-9177-86c2e664d560 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.1032083
May 31 16:20:58.064469 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-65f75c24-2887-4cdb-af62-1c0e691af622 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:58.093949 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-65f75c24-2887-4cdb-af62-1c0e691af622 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:58.109551 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-62f75a48-af5e-490f-b025-8353525efb0e req-fb622b41-727d-4dfa-8337-9fa9b8be40b8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0396974
May 31 16:20:58.147707 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-65f75c24-2887-4cdb-af62-1c0e691af622 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:58.152718 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-ab5b5f6f-df7a-4479-9dbc-4cb126e6e0b3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:58.165040 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65f75c24-2887-4cdb-af62-1c0e691af622 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e8b8f6fe-3a4d-4df4-9c5b-4e5aae937ca3,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:58.168924 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-65f75c24-2887-4cdb-af62-1c0e691af622 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:58.174372 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-65f75c24-2887-4cdb-af62-1c0e691af622 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:58.178891 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-65f75c24-2887-4cdb-af62-1c0e691af622 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/e8b8f6fe-3a4d-4df4-9c5b-4e5aae937ca3 HTTP/1.1" status: 204  len: 168 time: 0.1747303
May 31 16:20:58.383384 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e5eddb-262e-48a6-82b8-675efb3983ef req-afadcb35-79fd-421c-be15-7853bc9323e5 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:58.385028 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-48e5eddb-262e-48a6-82b8-675efb3983ef req-afadcb35-79fd-421c-be15-7853bc9323e5 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.1637120
May 31 16:20:58.393856 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 58688) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:58.408016 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-ab5bea86-552c-47c8-ac2c-d28375783997 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Request body: {'floatingip': {'port_id': '8cf870c7-bdf1-490f-adfa-61e27997bc91'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:20:58.488291 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ab5bea86-552c-47c8-ac2c-d28375783997 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for floatingip, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:58.544407 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87b81a87-4eac-4098-a5b2-81744ee451e0 req-460cd550-9e7b-4284-8aae-d6d3ef3cacee tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:58.545945 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-87b81a87-4eac-4098-a5b2-81744ee451e0 req-460cd550-9e7b-4284-8aae-d6d3ef3cacee tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.0923762
May 31 16:20:58.598923 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-87b81a87-4eac-4098-a5b2-81744ee451e0 req-fc749764-47b5-47d4-9e96-5b1ed5c29aa6 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0473497
May 31 16:20:59.004542 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 58714) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:59.127655 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-2113198119-network', 'tenant_id': '9f1c6309b90340f4bb161faff600d196'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:20:59.132853 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:59.136828 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Usage tracker for resource:network and tenant:9f1c6309b90340f4bb161faff600d196 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:59.139836 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:59.147547 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:59.157302 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Made reservation on behalf of 9f1c6309b90340f4bb161faff600d196 for: {'network': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:20:59.159722 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-639279'] for network, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:59.172858 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:59.191584 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:59.195519 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Usage tracker for resource:security_group_rule and tenant:9f1c6309b90340f4bb161faff600d196 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:59.198417 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:59.204326 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:59.287979 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:59.292003 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:59.295965 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c32883b4-e737-45c6-a258-d00ed28c1188 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:59.318680 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ab5bea86-552c-47c8-ac2c-d28375783997 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:59.322422 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 849}  {{(pid=91764) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 31 16:20:59.324391 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ab5bea86-552c-47c8-ac2c-d28375783997 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16621821'] for floatingip, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:59.330788 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4f8959c5-9563-4d9f-9b73-60d7bb2842ce,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:59.334980 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:59.337508 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:59.337927 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.db.segments_db [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Added segment 16d04e5d-5dfb-473e-b5b8-5041a96ac30f of type vlan for network 994ac3c2-7faa-4416-9efd-a0139199561a
May 31 16:20:59.364897 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732784079930'] for network, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:59.393994 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366'] for network, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:59.395321 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:59.395894 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:59.401351 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:20:59.503977 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Pushing event updated for resources: {'Network': ['ID=994ac3c2-7faa-4416-9efd-a0139199561a,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:20:59.510338 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:20:59.515594 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.5056608
May 31 16:20:59.516182 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 58724) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:20:59.518599 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Network 994ac3c2-7faa-4416-9efd-a0139199561a details requested by agent ovs-agent-dv-cinder-793814-1-iscsi with host dv-cinder-793814-1-iscsi {{(pid=91765) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 31 16:20:59.523768 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-4bf0bd61-f5f6-4e90-8336-7fed7ff9a3e0 admin admin] Request body: {'subnet': {'network_id': '994ac3c2-7faa-4416-9efd-a0139199561a', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-2113198119-subnet', 'tenant_id': '9f1c6309b90340f4bb161faff600d196', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:20:59.529596 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-4bf0bd61-f5f6-4e90-8336-7fed7ff9a3e0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:20:59.534800 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-4bf0bd61-f5f6-4e90-8336-7fed7ff9a3e0 admin admin] Usage tracker for resource:subnet and tenant:9f1c6309b90340f4bb161faff600d196 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:20:59.539283 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-4bf0bd61-f5f6-4e90-8336-7fed7ff9a3e0 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:20:59.545931 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-4bf0bd61-f5f6-4e90-8336-7fed7ff9a3e0 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:20:59.560309 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4bf0bd61-f5f6-4e90-8336-7fed7ff9a3e0 admin admin] Made reservation on behalf of 9f1c6309b90340f4bb161faff600d196 for: {'subnet': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:20:59.563008 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-4bf0bd61-f5f6-4e90-8336-7fed7ff9a3e0 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:20:59.595885 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.l3_db [None req-ab5bea86-552c-47c8-ac2c-d28375783997 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Floating IP fce714cf-2d56-4577-90b0-4e3cd0299039 associated. External IP: 172.27.0.136, port: 8cf870c7-bdf1-490f-adfa-61e27997bc91.
May 31 16:20:59.964757 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80baedc5-c187-4f7d-a181-8e2366e1b33d req-7969424b-add6-4331-9ae1-be8a52d29039 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:20:59.966255 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-80baedc5-c187-4f7d-a181-8e2366e1b33d req-7969424b-add6-4331-9ae1-be8a52d29039 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.2425473
May 31 16:20:59.984099 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ab5bea86-552c-47c8-ac2c-d28375783997 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Router 8471b167-8540-4806-9932-e05fcb75a12b has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91763) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:21:00.020845 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-80baedc5-c187-4f7d-a181-8e2366e1b33d req-76834993-b885-4a07-a41d-3fc6bd8062a0 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0484960
May 31 16:21:00.109573 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-4bf0bd61-f5f6-4e90-8336-7fed7ff9a3e0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357'] for subnet, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:00.114309 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-0fe1c3e3-5c29-4652-9d5b-8b7623049a73 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:00.183175 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ab5bea86-552c-47c8-ac2c-d28375783997 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:21:00.188671 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ab5bea86-552c-47c8-ac2c-d28375783997 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for floatingip, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:00.196943 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf0bd61-f5f6-4e90-8336-7fed7ff9a3e0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=98f9a0cd-16a5-484e-8a74-280b908828b9,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:00.204834 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4bf0bd61-f5f6-4e90-8336-7fed7ff9a3e0 admin admin] Checking segment: {'id': '16d04e5d-5dfb-473e-b5b8-5041a96ac30f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 849, 'network_id': '994ac3c2-7faa-4416-9efd-a0139199561a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:00.205052 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abbd4440-fb9e-4d44-be13-296a0488e2c8 None None] Sync routers for ids ['8471b167-8540-4806-9932-e05fcb75a12b'] in dv-cinder-793814-1-iscsi {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:21:00.205687 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4bf0bd61-f5f6-4e90-8336-7fed7ff9a3e0 admin admin] Network hostable DHCP agents. Network: 994ac3c2-7faa-4416-9efd-a0139199561a, hostable agents: ['5c9859e8-5965-4c86-8b2b-8fab235cbf66'], hosted agents: [] {{(pid=91764) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 31 16:21:00.208298 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-4bf0bd61-f5f6-4e90-8336-7fed7ff9a3e0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:00.218179 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-abbd4440-fb9e-4d44-be13-296a0488e2c8 None None] Routers {'8471b167-8540-4806-9932-e05fcb75a12b'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:21:00.218798 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-abbd4440-fb9e-4d44-be13-296a0488e2c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f14279413d0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:20:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['8471b167-8540-4806-9932-e05fcb75a12b'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:00.235430 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4bf0bd61-f5f6-4e90-8336-7fed7ff9a3e0 admin admin] Network 994ac3c2-7faa-4416-9efd-a0139199561a is scheduled to be hosted by DHCP agent 5c9859e8-5965-4c86-8b2b-8fab235cbf66 with binding_index 1 {{(pid=91764) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 31 16:21:00.247233 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-4bf0bd61-f5f6-4e90-8336-7fed7ff9a3e0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793814-1-iscsi, 994ac3c2-7faa-4416-9efd-a0139199561a) {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:00.256210 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-932fe286-4343-4eb3-be18-e9014c2b0241 None None] Network 994ac3c2-7faa-4416-9efd-a0139199561a requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:21:00.265040 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bf0bd61-f5f6-4e90-8336-7fed7ff9a3e0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:00.265655 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-4bf0bd61-f5f6-4e90-8336-7fed7ff9a3e0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:00.289184 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-ab5bea86-552c-47c8-ac2c-d28375783997 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "PUT /v2.0/floatingips/fce714cf-2d56-4577-90b0-4e3cd0299039 HTTP/1.1" status: 200  len: 992 time: 1.8909419
May 31 16:21:00.289184 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '236769ac-e375-4497-9fe7-7425ccc79d09', 'tag': '8cf870c7-bdf1-490f-adfa-61e27997bc91'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:21:00.289678 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a0cf849c-b0f7-453a-8fa1-81437376b164" -d '{"events": [{"name": "network-changed", "server_uuid": "236769ac-e375-4497-9fe7-7425ccc79d09", "tag": "8cf870c7-bdf1-490f-adfa-61e27997bc91"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:21:00.326121 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-4bf0bd61-f5f6-4e90-8336-7fed7ff9a3e0 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 0.7963963
May 31 16:21:00.348978 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:21:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cc1b55a9-b7fd-4edf-ac3b-607f8ee4fee4 x-openstack-request-id: req-cc1b55a9-b7fd-4edf-ac3b-607f8ee4fee4 {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:21:00.350081 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "236769ac-e375-4497-9fe7-7425ccc79d09", "tag": "8cf870c7-bdf1-490f-adfa-61e27997bc91", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:21:00.350321 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-cc1b55a9-b7fd-4edf-ac3b-607f8ee4fee4 {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:21:00.350736 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '236769ac-e375-4497-9fe7-7425ccc79d09', 'tag': '8cf870c7-bdf1-490f-adfa-61e27997bc91', 'status': 'completed', 'code': 200}
May 31 16:21:00.469964 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0cf849c-b0f7-453a-8fa1-81437376b164 req-64efb65c-4f44-4110-a4f7-828d06468f11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:00.472070 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a0cf849c-b0f7-453a-8fa1-81437376b164 req-64efb65c-4f44-4110-a4f7-828d06468f11 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=12203182731d4a61acb7fc5914aef425&device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 1099 time: 0.0823171
May 31 16:21:00.476196 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-abbd4440-fb9e-4d44-be13-296a0488e2c8 None None] Set router 8471b167-8540-4806-9932-e05fcb75a12b gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:21:00.513091 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15b2520d-ae74-48d8-9771-c16d287a246c None None] Network 994ac3c2-7faa-4416-9efd-a0139199561a requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:21:00.636278 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0cf849c-b0f7-453a-8fa1-81437376b164 req-f8a75f8e-1d67-4aee-abc2-72603652f097 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:00.638208 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a0cf849c-b0f7-453a-8fa1-81437376b164 req-f8a75f8e-1d67-4aee-abc2-72603652f097 service neutron] 10.222.0.63 "GET /v2.0/networks?id=be7d7603-734f-43bb-92a8-ed07a835aeb5 HTTP/1.1" status: 200  len: 917 time: 0.1597042
May 31 16:21:00.772544 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a0cf849c-b0f7-453a-8fa1-81437376b164 req-e69ae247-6f44-4ddd-baf8-f1057570ad43 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=8cf870c7-bdf1-490f-adfa-61e27997bc91 HTTP/1.1" status: 200  len: 1000 time: 0.1236830
May 31 16:21:00.851537 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0cf849c-b0f7-453a-8fa1-81437376b164 req-14815e86-6fe2-40c9-85db-8049147c51f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:00.853234 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a0cf849c-b0f7-453a-8fa1-81437376b164 req-14815e86-6fe2-40c9-85db-8049147c51f0 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=eb5363fe-ee39-4adc-b299-6098caad681d HTTP/1.1" status: 200  len: 855 time: 0.0730407
May 31 16:21:00.965407 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0cf849c-b0f7-453a-8fa1-81437376b164 req-94b59480-82d2-42e0-b8d8-d9ca1bc9ff05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:00.966906 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a0cf849c-b0f7-453a-8fa1-81437376b164 req-94b59480-82d2-42e0-b8d8-d9ca1bc9ff05 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=be7d7603-734f-43bb-92a8-ed07a835aeb5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1022105
May 31 16:21:01.057884 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-abbd4440-fb9e-4d44-be13-296a0488e2c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f14279413d0>, [{'id': '8471b167-8540-4806-9932-e05fcb75a12b', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:55Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '12203182731d4a61acb7fc5914aef425', 'gw_port': {'id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:83:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:19:56Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': 'fce714cf-2d56-4577-90b0-4e3cd0299039', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'floating_ip_address': '172.27.0.136', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'port_id': '8cf870c7-bdf1-490f-adfa-61e27997bc91', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 113, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'mac_address': 'fa:16:3e:b1:f3:43', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '236769ac-e375-4497-9fe7-7425ccc79d09', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:20:22Z', 'updated_at': '2021-05-31T16:20:59Z', 'revision_number': 1, 'project_id': '12203182731d4a61acb7fc5914aef425', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'db126eb4-e252-4765-86f1-09d3f20549df', 'name': '', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'mac_address': 'fa:16:3e:63:bd:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:04Z', 'updated_at': '2021-05-31T16:20:20Z', 'revision_number': 5, 'project_id': '12203182731d4a61acb7fc5914aef425', 'subnets': [{'id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:01.064057 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abbd4440-fb9e-4d44-be13-296a0488e2c8 None None] Checking router: 8471b167-8540-4806-9932-e05fcb75a12b for host: dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:21:01.076124 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-abbd4440-fb9e-4d44-be13-296a0488e2c8 None None] Routers {'8471b167-8540-4806-9932-e05fcb75a12b'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:21:01.077113 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-abbd4440-fb9e-4d44-be13-296a0488e2c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f14279413d0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:20:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['8471b167-8540-4806-9932-e05fcb75a12b'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:01.109912 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 58770) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:01.124150 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-622148564-network', 'tenant_id': 'f1f8f5730e8e49ffb9caa3a72d8c35e7'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:01.133573 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:01.141149 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Usage tracker for resource:network and tenant:f1f8f5730e8e49ffb9caa3a72d8c35e7 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:01.146842 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:01.167010 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:01.228897 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Made reservation on behalf of f1f8f5730e8e49ffb9caa3a72d8c35e7 for: {'network': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:21:01.231859 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-639279'] for network, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:01.254788 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a0cf849c-b0f7-453a-8fa1-81437376b164 req-6a1b1558-02d1-45fb-a3ca-b5d6236a8706 service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2718134
May 31 16:21:01.261279 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:01.317103 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-abbd4440-fb9e-4d44-be13-296a0488e2c8 None None] Set router 8471b167-8540-4806-9932-e05fcb75a12b gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:21:01.390439 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:01.466187 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Usage tracker for resource:security_group_rule and tenant:f1f8f5730e8e49ffb9caa3a72d8c35e7 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:01.472135 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:01.510633 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:01.613796 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17bfdc4d-565a-4674-b935-8632cdca18bb req-e92c3c52-4cd4-43e4-8fd1-afcd0725c605 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:01.615453 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-17bfdc4d-565a-4674-b935-8632cdca18bb req-e92c3c52-4cd4-43e4-8fd1-afcd0725c605 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.4205749
May 31 16:21:01.629925 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a0cf849c-b0f7-453a-8fa1-81437376b164 req-43f17059-8d52-472a-8279-21c883678fce service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3550444
May 31 16:21:01.702516 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-17bfdc4d-565a-4674-b935-8632cdca18bb req-999ba713-920d-4a65-b302-3a41f7702096 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0752323
May 31 16:21:01.758003 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:01.766560 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:01.797092 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 835}  {{(pid=91764) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 31 16:21:01.814624 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:01.819687 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.db.segments_db [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Added segment 36a7ddf9-92d3-4847-ad54-1a002be7e2aa of type vlan for network f30be21a-c39e-4fce-8c00-5f877e95758a
May 31 16:21:01.839299 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:01.872300 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732784079930'] for network, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:01.886358 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b45bcc60-e9a6-4f12-9b50-f94a6e14d9d4,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:01.890858 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:01.916867 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366'] for network, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:01.918507 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:01.918987 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:01.924356 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-925974de-867d-4b37-ae05-e8f232683885 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:01.938406 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-abbd4440-fb9e-4d44-be13-296a0488e2c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f14279413d0>, [{'id': '8471b167-8540-4806-9932-e05fcb75a12b', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:55Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '12203182731d4a61acb7fc5914aef425', 'gw_port': {'id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:83:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:19:56Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': 'fce714cf-2d56-4577-90b0-4e3cd0299039', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'floating_ip_address': '172.27.0.136', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'port_id': '8cf870c7-bdf1-490f-adfa-61e27997bc91', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 113, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'mac_address': 'fa:16:3e:b1:f3:43', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '236769ac-e375-4497-9fe7-7425ccc79d09', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:20:22Z', 'updated_at': '2021-05-31T16:20:59Z', 'revision_number': 1, 'project_id': '12203182731d4a61acb7fc5914aef425', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'db126eb4-e252-4765-86f1-09d3f20549df', 'name': '', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'mac_address': 'fa:16:3e:63:bd:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:04Z', 'updated_at': '2021-05-31T16:20:20Z', 'revision_number': 5, 'project_id': '12203182731d4a61acb7fc5914aef425', 'subnets': [{'id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:01.942583 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abbd4440-fb9e-4d44-be13-296a0488e2c8 None None] The sync data for ids ['8471b167-8540-4806-9932-e05fcb75a12b'] in dv-cinder-793814-1-iscsi is: [{'id': '8471b167-8540-4806-9932-e05fcb75a12b', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:55Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '12203182731d4a61acb7fc5914aef425', 'gw_port': {'id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:83:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:19:56Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': 'fce714cf-2d56-4577-90b0-4e3cd0299039', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'floating_ip_address': '172.27.0.136', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'port_id': '8cf870c7-bdf1-490f-adfa-61e27997bc91', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 113, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'mac_address': 'fa:16:3e:b1:f3:43', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '236769ac-e375-4497-9fe7-7425ccc79d09', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:20:22Z', 'updated_at': '2021-05-31T16:20:59Z', 'revision_number': 1, 'project_id': '12203182731d4a61acb7fc5914aef425', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'db126eb4-e252-4765-86f1-09d3f20549df', 'name': '', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'mac_address': 'fa:16:3e:63:bd:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:04Z', 'updated_at': '2021-05-31T16:20:20Z', 'revision_number': 5, 'project_id': '12203182731d4a61acb7fc5914aef425', 'subnets': [{'id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:21:02.031111 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 0.9198878
May 31 16:21:02.032105 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Pushing event updated for resources: {'Network': ['ID=f30be21a-c39e-4fce-8c00-5f877e95758a,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:02.035794 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 58788) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:02.042544 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:02.044005 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Network f30be21a-c39e-4fce-8c00-5f877e95758a details requested by agent ovs-agent-dv-cinder-793814-1-iscsi with host dv-cinder-793814-1-iscsi {{(pid=91765) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 31 16:21:02.055298 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-2e6d90db-07f7-452c-8a01-13da0c5c7fec admin admin] Request body: {'subnet': {'network_id': 'f30be21a-c39e-4fce-8c00-5f877e95758a', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-622148564-subnet', 'tenant_id': 'f1f8f5730e8e49ffb9caa3a72d8c35e7', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:02.060717 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-2e6d90db-07f7-452c-8a01-13da0c5c7fec admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:02.066598 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-2e6d90db-07f7-452c-8a01-13da0c5c7fec admin admin] Usage tracker for resource:subnet and tenant:f1f8f5730e8e49ffb9caa3a72d8c35e7 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:02.070989 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-2e6d90db-07f7-452c-8a01-13da0c5c7fec admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:02.080561 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-2e6d90db-07f7-452c-8a01-13da0c5c7fec admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:02.097196 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e6d90db-07f7-452c-8a01-13da0c5c7fec admin admin] Made reservation on behalf of f1f8f5730e8e49ffb9caa3a72d8c35e7 for: {'subnet': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:21:02.100520 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2e6d90db-07f7-452c-8a01-13da0c5c7fec admin admin] Notify callbacks [] for subnet, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:02.114021 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 58794) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:02.276076 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4974834-748f-4052-bd1f-c386983cccf5 None None] New status for floating IP fce714cf-2d56-4577-90b0-4e3cd0299039: ACTIVE {{(pid=91765) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 31 16:21:02.276739 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-a1b4dfd6-dc2b-486b-a444-e01b887aeab6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:02.296582 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-a1b4dfd6-dc2b-486b-a444-e01b887aeab6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:02.307092 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-a1b4dfd6-dc2b-486b-a444-e01b887aeab6 admin admin] Usage tracker for resource:security_group_rule and tenant:5d75e7c18e484fa6827316a4ca6c228a is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:02.310299 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-a1b4dfd6-dc2b-486b-a444-e01b887aeab6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:02.316544 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-a1b4dfd6-dc2b-486b-a444-e01b887aeab6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:02.426949 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-a1b4dfd6-dc2b-486b-a444-e01b887aeab6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:02.431726 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-a1b4dfd6-dc2b-486b-a444-e01b887aeab6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:02.448344 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-1c43fb06-9c54-4b5a-ac4a-1f5104457308 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:02.497737 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1b4dfd6-dc2b-486b-a444-e01b887aeab6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dfa50e9c-bce7-48ae-aa87-12484b4d33ab,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:02.505215 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-a1b4dfd6-dc2b-486b-a444-e01b887aeab6 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=5d75e7c18e484fa6827316a4ca6c228a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3901429
May 31 16:21:02.506443 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 58800) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:02.507269 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-a1b4dfd6-dc2b-486b-a444-e01b887aeab6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:02.574873 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2e6d90db-07f7-452c-8a01-13da0c5c7fec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357'] for subnet, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:02.580584 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:02.585172 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-01129fde-ea47-4699-8a49-bbc103648295 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:02.614969 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-01129fde-ea47-4699-8a49-bbc103648295 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:02.668493 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e6d90db-07f7-452c-8a01-13da0c5c7fec admin admin] Checking segment: {'id': '36a7ddf9-92d3-4847-ad54-1a002be7e2aa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 835, 'network_id': 'f30be21a-c39e-4fce-8c00-5f877e95758a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91763) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:02.668936 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e6d90db-07f7-452c-8a01-13da0c5c7fec admin admin] Network hostable DHCP agents. Network: f30be21a-c39e-4fce-8c00-5f877e95758a, hostable agents: ['5c9859e8-5965-4c86-8b2b-8fab235cbf66'], hosted agents: [] {{(pid=91763) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 31 16:21:02.672898 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e6d90db-07f7-452c-8a01-13da0c5c7fec admin admin] Pushing event updated for resources: {'Subnet': ['ID=8362573f-a246-46f9-a14b-65bf63130a75,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:02.680362 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-2e6d90db-07f7-452c-8a01-13da0c5c7fec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:02.700027 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-01129fde-ea47-4699-8a49-bbc103648295 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:02.706421 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-565af746-6a5c-4afa-8846-80367b05f097 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:02.713576 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e6d90db-07f7-452c-8a01-13da0c5c7fec admin admin] Network f30be21a-c39e-4fce-8c00-5f877e95758a is scheduled to be hosted by DHCP agent 5c9859e8-5965-4c86-8b2b-8fab235cbf66 with binding_index 1 {{(pid=91763) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 31 16:21:02.725926 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01129fde-ea47-4699-8a49-bbc103648295 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dfa50e9c-bce7-48ae-aa87-12484b4d33ab,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:02.736639 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-2e6d90db-07f7-452c-8a01-13da0c5c7fec admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793814-1-iscsi, f30be21a-c39e-4fce-8c00-5f877e95758a) {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:02.748819 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-01129fde-ea47-4699-8a49-bbc103648295 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:02.752877 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-01129fde-ea47-4699-8a49-bbc103648295 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/dfa50e9c-bce7-48ae-aa87-12484b4d33ab HTTP/1.1" status: 204  len: 168 time: 0.2363713
May 31 16:21:02.752877 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-01129fde-ea47-4699-8a49-bbc103648295 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:02.753287 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e6d90db-07f7-452c-8a01-13da0c5c7fec admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:02.759254 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2e6d90db-07f7-452c-8a01-13da0c5c7fec admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:02.764490 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-96cec552-7995-46cb-8bfa-e0d3072b7a0c None None] Network f30be21a-c39e-4fce-8c00-5f877e95758a requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:21:02.831659 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-2e6d90db-07f7-452c-8a01-13da0c5c7fec admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.7945776
May 31 16:21:03.003663 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5fc597c-cbb4-473d-8fa1-21794daed890 req-4a86be24-659d-4e4d-9438-e69632d89dba tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:03.010983 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b5fc597c-cbb4-473d-8fa1-21794daed890 req-4a86be24-659d-4e4d-9438-e69632d89dba tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.1587090
May 31 16:21:03.080211 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b5fc597c-cbb4-473d-8fa1-21794daed890 req-22aee9a4-1132-4a1a-8d1a-54f9e336b4eb tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0625324
May 31 16:21:03.121635 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7ab3f660-9150-49d7-8a8f-f4b80fb039fa None None] Network f30be21a-c39e-4fce-8c00-5f877e95758a requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:21:03.384222 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-4cd6dd6c-e48f-47d9-9969-3a682676f799 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:03.385839 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-4cd6dd6c-e48f-47d9-9969-3a682676f799 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/networks?id=1097eeec-06a4-406d-ab4a-02e0123072d2 HTTP/1.1" status: 200  len: 814 time: 0.1735620
May 31 16:21:03.402962 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-a7b79549-230e-4371-b67a-2834882797a1 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/quotas/0eb6e65b3f844417816fb1e5c88a8004 HTTP/1.1" status: 200  len: 375 time: 0.0106368
May 31 16:21:03.489344 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-27ef0a69-f226-4ba4-a5f4-3c721a27b120 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=0eb6e65b3f844417816fb1e5c88a8004&fields=id HTTP/1.1" status: 200  len: 255 time: 0.0803475
May 31 16:21:03.643844 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-4b5ccf4e-684f-46c4-934e-36e9c0a6ae3f service neutron] 10.222.0.43 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1445773
May 31 16:21:03.677090 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 58860) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:03.807978 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-efc01106-4cb2-4153-86b9-2155f38685e4 service neutron] 10.222.0.43 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1569529
May 31 16:21:03.819211 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1861877954-network', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:03.825089 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:03.829053 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Usage tracker for resource:network and tenant:092115f69b8e401b8c334f7b3e797aad is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:03.832206 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:03.838759 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:03.851704 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Made reservation on behalf of 092115f69b8e401b8c334f7b3e797aad for: {'network': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:21:03.854352 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-639279'] for network, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:03.867897 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:03.883199 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:03.887121 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Usage tracker for resource:security_group_rule and tenant:092115f69b8e401b8c334f7b3e797aad is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:03.894283 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:03.899241 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:04.006887 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4248f9ca-d8f8-47c8-8a77-8b556d3af63c req-d426ac53-13d8-49ce-af15-bc74c9147936 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 210 time: 0.0519919
May 31 16:21:04.011500 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:04.018325 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:04.033283 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e3aafdca-e1a7-4c81-8608-038b6a838043 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:04.043631 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 805}  {{(pid=91763) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 31 16:21:04.067147 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:04.067489 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.segments_db [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Added segment fb1fd409-498f-4f29-82bc-1d244a7a3ed1 of type vlan for network 5b237728-dc31-4203-bbac-66ce3db1593a
May 31 16:21:04.073466 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0334ae0f-69e2-435f-8cca-c6e8551245b4,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:04.076780 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:04.100759 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732784079930'] for network, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:04.132123 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366'] for network, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:04.135591 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:04.136610 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:04.140203 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-ed665694-83ff-475d-a1b3-808644c65c3c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:04.254020 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 0.5751889
May 31 16:21:04.254929 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Pushing event updated for resources: {'Network': ['ID=5b237728-dc31-4203-bbac-66ce3db1593a,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:04.257455 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 58880) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:04.259079 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:04.265978 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Network 5b237728-dc31-4203-bbac-66ce3db1593a details requested by agent ovs-agent-dv-cinder-793814-1-iscsi with host dv-cinder-793814-1-iscsi {{(pid=91765) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 31 16:21:04.277961 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-4a5b643f-de3d-40b6-9ed0-ee605eba9f33 admin admin] Request body: {'subnet': {'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1861877954-subnet', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'ip_version': 4}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:04.283169 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-4a5b643f-de3d-40b6-9ed0-ee605eba9f33 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:04.296913 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-4a5b643f-de3d-40b6-9ed0-ee605eba9f33 admin admin] Usage tracker for resource:subnet and tenant:092115f69b8e401b8c334f7b3e797aad is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:04.303438 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-4a5b643f-de3d-40b6-9ed0-ee605eba9f33 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:04.311831 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-4a5b643f-de3d-40b6-9ed0-ee605eba9f33 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:04.329632 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4a5b643f-de3d-40b6-9ed0-ee605eba9f33 admin admin] Made reservation on behalf of 092115f69b8e401b8c334f7b3e797aad for: {'subnet': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:21:04.331900 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-4a5b643f-de3d-40b6-9ed0-ee605eba9f33 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:04.409812 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7df6b20-392a-42ab-8567-1d0a91330274 req-07ec08a3-212e-48ea-8dfc-2bbf39b37d5d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:04.411375 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c7df6b20-392a-42ab-8567-1d0a91330274 req-07ec08a3-212e-48ea-8dfc-2bbf39b37d5d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.1982958
May 31 16:21:04.487048 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c7df6b20-392a-42ab-8567-1d0a91330274 req-e8b8a14f-3580-4c1d-b406-5f37bf954c3d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0623403
May 31 16:21:04.905333 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-4a5b643f-de3d-40b6-9ed0-ee605eba9f33 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357'] for subnet, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:04.913398 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:05.018107 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-ca522b4b-9d9b-4fe6-9481-5dcec9d9437a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:05.041058 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a5b643f-de3d-40b6-9ed0-ee605eba9f33 admin admin] Pushing event updated for resources: {'Subnet': ['ID=995d9a2e-7e88-458e-9385-d135c0e07276,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:05.044463 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-4a5b643f-de3d-40b6-9ed0-ee605eba9f33 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:05.054871 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a5b643f-de3d-40b6-9ed0-ee605eba9f33 admin admin] Checking segment: {'id': 'fb1fd409-498f-4f29-82bc-1d244a7a3ed1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:05.055242 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4a5b643f-de3d-40b6-9ed0-ee605eba9f33 admin admin] Network hostable DHCP agents. Network: 5b237728-dc31-4203-bbac-66ce3db1593a, hostable agents: ['5c9859e8-5965-4c86-8b2b-8fab235cbf66'], hosted agents: [] {{(pid=91764) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 31 16:21:05.079300 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4a5b643f-de3d-40b6-9ed0-ee605eba9f33 admin admin] Network 5b237728-dc31-4203-bbac-66ce3db1593a is scheduled to be hosted by DHCP agent 5c9859e8-5965-4c86-8b2b-8fab235cbf66 with binding_index 1 {{(pid=91764) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 31 16:21:05.091715 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-4a5b643f-de3d-40b6-9ed0-ee605eba9f33 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793814-1-iscsi, 5b237728-dc31-4203-bbac-66ce3db1593a) {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:05.098498 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a5b643f-de3d-40b6-9ed0-ee605eba9f33 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:05.100760 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-4a5b643f-de3d-40b6-9ed0-ee605eba9f33 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:05.102167 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a66b5ae-50e8-4bb3-b102-d6546701966f None None] Network 5b237728-dc31-4203-bbac-66ce3db1593a requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:21:05.128347 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-4a5b643f-de3d-40b6-9ed0-ee605eba9f33 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 848 time: 0.8569629
May 31 16:21:05.128571 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 58894) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:05.134097 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:05.141735 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:05.182020 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Usage tracker for resource:router and tenant:092115f69b8e401b8c334f7b3e797aad is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:05.189571 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:05.195453 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-75ba13be-f4bc-40c0-a0dd-adbf61687cb7 req-cc7ec174-3534-4f08-81a5-b3fa609bf2cb tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 210 time: 0.0563774
May 31 16:21:05.199454 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:05.219012 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-16623804', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-697'] for router, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:05.220048 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-16618684', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-16621667', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-16430734', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-672'] for router, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:05.239246 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:05.372970 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp87ca72be-1027-56d4-a8d3-ba9dae998815-5b237728-dc31-4203-bbac-66ce3db1593a', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'fixed_ips': [{'subnet_id': '995d9a2e-7e88-458e-9385-d135c0e07276'}]}} from dv-cinder-793814-1-iscsi. {{(pid=91765) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 31 16:21:05.374222 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:05.516733 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16621638', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16623758', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-722'] for router, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:05.539476 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.db_base_plugin_common [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Allocated IP 172.20.0.2 (5b237728-dc31-4203-bbac-66ce3db1593a/995d9a2e-7e88-458e-9385-d135c0e07276/5b8fe218-6e1c-4c2b-9624-2e573c7d41d1) {{(pid=91765) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:21:05.717860 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2efbc50d-7807-4e97-91d3-3f50f8bf8f14 req-813c144f-0d46-47d3-b879-bbb5905f4bf2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:05.719246 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2efbc50d-7807-4e97-91d3-3f50f8bf8f14 req-813c144f-0d46-47d3-b879-bbb5905f4bf2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.1095347
May 31 16:21:05.759987 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Notify callbacks [] for port, precommit_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:05.770362 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Transition to ACTIVE for port object 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1 will not be triggered until provisioned by entity L2. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:05.791643 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Transition to ACTIVE for port object 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1 will not be triggered until provisioned by entity DHCP. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:05.797881 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:05.801394 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:05.839074 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2efbc50d-7807-4e97-91d3-3f50f8bf8f14 req-3ce76439-3768-4fda-ad1a-a67b5fb2deac tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1094234
May 31 16:21:05.859863 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Network 5b237728-dc31-4203-bbac-66ce3db1593a is already hosted by enough agents. {{(pid=91765) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:21:05.868137 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.scheduler.base_scheduler [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Resources bound (agent type, host, resource id):  {{(pid=91765) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:05.872002 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Received port after_create {{(pid=91765) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:21:05.975512 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Attempting to bind port 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1 on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:21:05.975893 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Attempting to bind port 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1 by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': 'fb1fd409-498f-4f29-82bc-1d244a7a3ed1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a'}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:21:05.976251 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Attempting to bind port 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1 on network 5b237728-dc31-4203-bbac-66ce3db1593a {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:21:05.978562 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Pushing event updated for resources: {'Port': ['ID=5b8fe218-6e1c-4c2b-9624-2e573c7d41d1,revision_number=1']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:05.979909 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:05.989132 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:05.989469 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:05.989876 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:05.990713 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:05.991040 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:05.991359 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:05.991876 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:05.992201 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:05.992522 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:05.992836 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:05.993152 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:05.993463 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:05.997623 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:06.003906 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 20, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:21:06.003906 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Checking segment: {'id': 'fb1fd409-498f-4f29-82bc-1d244a7a3ed1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91765) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:06.003906 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:06.003906 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Bound using segment: {'id': 'fb1fd409-498f-4f29-82bc-1d244a7a3ed1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a'} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:21:06.003906 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Bound port: 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb1fd409-498f-4f29-82bc-1d244a7a3ed1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a'}}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:21:06.003906 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:06.025913 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:06.128882 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] For port 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91765) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:21:06.135878 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] For port 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=5b8fe218-6e1c-4c2b-9624-2e573c7d41d1,segment=NetworkSegment(fb1fd409-498f-4f29-82bc-1d244a7a3ed1),segment_id=fb1fd409-498f-4f29-82bc-1d244a7a3ed1)] {{(pid=91765) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:21:06.142921 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:06.153167 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:06.206875 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Allocated IP 172.27.0.229 (00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c/96709d85-d0fe-4cf8-b232-eaf6b143ebe6/6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:21:06.288462 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Pushing event updated for resources: {'Port': ['ID=5b8fe218-6e1c-4c2b-9624-2e573c7d41d1,revision_number=2']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:06.304007 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:06.418012 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e470ff10-172b-4a3d-ba41-7218514ff79c req-35bf0031-7411-4b49-ba1c-9dbaa0d89660 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 210 time: 0.0687740
May 31 16:21:06.501741 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:06.540374 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:06.544546 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-912d6e6b-8f02-4624-af39-387abc1a48bb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:06.615677 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:21:06.618808 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:06.622855 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:21:06.708242 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:06.771857 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Pushing event updated for resources: {'Port': ['ID=6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:06.783528 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:21:06.827740 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.283s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:07.163923 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:07.228761 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e06f0da1-cf3e-4b53-ba3e-40a3231a0106 req-d6789bac-841b-4cff-9cb0-ae56dc1463f2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:07.230194 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e06f0da1-cf3e-4b53-ba3e-40a3231a0106 req-d6789bac-841b-4cff-9cb0-ae56dc1463f2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.2629097
May 31 16:21:07.289499 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18e65046-3b25-432b-af5e-141e8a527464 None None] Network 5b237728-dc31-4203-bbac-66ce3db1593a requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:21:07.362834 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e06f0da1-cf3e-4b53-ba3e-40a3231a0106 req-4d89baa2-be5e-483b-8538-40c7240e83f9 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1241338
May 31 16:21:07.397870 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-508dc191-cbd6-41e8-9cc5-005e09112aa2 None None] Provisioning for port 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1 completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:21:07.407747 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-508dc191-cbd6-41e8-9cc5-005e09112aa2 None None] Provisioning complete for port 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:07.408132 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-508dc191-cbd6-41e8-9cc5-005e09112aa2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:07.620623 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-119d901f-8302-4b59-8f79-11880665def6 req-6f6689f1-72a5-454f-8a27-e09942209461 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 210 time: 0.0669382
May 31 16:21:07.638672 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-16623797', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16621573'] for router, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:07.671242 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-508dc191-cbd6-41e8-9cc5-005e09112aa2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:07.714845 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-508dc191-cbd6-41e8-9cc5-005e09112aa2 None None] For port 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=5b8fe218-6e1c-4c2b-9624-2e573c7d41d1,segment=NetworkSegment(fb1fd409-498f-4f29-82bc-1d244a7a3ed1),segment_id=fb1fd409-498f-4f29-82bc-1d244a7a3ed1)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:21:07.726910 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-508dc191-cbd6-41e8-9cc5-005e09112aa2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:07.728600 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:07.808640 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-508dc191-cbd6-41e8-9cc5-005e09112aa2 None None] Pushing event updated for resources: {'Port': ['ID=5b8fe218-6e1c-4c2b-9624-2e573c7d41d1,revision_number=3']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:07.812246 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-508dc191-cbd6-41e8-9cc5-005e09112aa2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:07.892522 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Router 80126872-1960-4f13-9ca2-0eaf66181e32 is scheduled to L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e with binding_index 1 {{(pid=91764) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 31 16:21:07.895630 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:07.953002 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-ec1bf687-0c94-438f-83ac-dbc5a9eb805d None None] Provisioning complete for port 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:07.953503 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-ec1bf687-0c94-438f-83ac-dbc5a9eb805d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:08.095402 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91764) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:21:08.105601 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] Sync routers for ids ['80126872-1960-4f13-9ca2-0eaf66181e32'] in dv-cinder-793814-1-iscsi {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:21:08.116971 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] Routers {'80126872-1960-4f13-9ca2-0eaf66181e32'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:21:08.118039 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426ffc0a0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:20:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['80126872-1960-4f13-9ca2-0eaf66181e32'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:08.128430 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Notify callbacks [] for router, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:08.134669 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 58930) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:08.135337 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201  len: 924 time: 3.0045907
May 31 16:21:08.229335 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-b4cc88e9-57e1-4fe9-a966-434493f4d577 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:08.332026 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] Set router 80126872-1960-4f13-9ca2-0eaf66181e32 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:21:08.643334 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa30131e-ba1a-46a3-9af4-9ced5ce5d85a req-ebe0d6b6-827b-4fc4-ad6b-7c8289ed783f tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:08.654989 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-aa30131e-ba1a-46a3-9af4-9ced5ce5d85a req-ebe0d6b6-827b-4fc4-ad6b-7c8289ed783f tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.1015716
May 31 16:21:08.684469 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426ffc0a0>, [{'id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229'}], 'enable_snat': True}, 'gw_port_id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:05Z', 'updated_at': '2021-05-31T16:21:06Z', 'revision_number': 3, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'gw_port': {'id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:b8:5a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:06Z', 'updated_at': '2021-05-31T16:21:06Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:08.701658 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] Checking router: 80126872-1960-4f13-9ca2-0eaf66181e32 for host: dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:21:08.701993 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] Updating router 80126872-1960-4f13-9ca2-0eaf66181e32 port 6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4 binding host dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 31 16:21:08.769475 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-aa30131e-ba1a-46a3-9af4-9ced5ce5d85a req-1b658b92-1917-4072-8e1c-24be2a525c27 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1130390
May 31 16:21:08.776530 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:08.815167 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:08.989055 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:08.989429 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:09.084821 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ed9ab1d6-ef8d-4264-994f-6a5bcd223034 req-869bf726-75bb-4dd4-940c-acdb00609462 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 210 time: 0.2481446
May 31 16:21:09.093141 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:09.292545 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:09.310734 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-5cf0e226-97d4-4142-8403-b3ebd5d1323b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:09.312485 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-5cf0e226-97d4-4142-8403-b3ebd5d1323b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.63 "GET /v2.0/networks?id=1097eeec-06a4-406d-ab4a-02e0123072d2 HTTP/1.1" status: 200  len: 814 time: 0.3018212
May 31 16:21:09.388369 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Allocated IP 172.20.0.1 (5b237728-dc31-4203-bbac-66ce3db1593a/995d9a2e-7e88-458e-9385-d135c0e07276/27a83f61-e253-4ba1-954c-e810e9a33917) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:21:09.421481 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] Notify callbacks [] for port, precommit_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:09.435348 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.provisioning_blocks [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] Transition to ACTIVE for port object 6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4 will not be triggered until provisioned by entity L2. {{(pid=91766) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:09.442885 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:09.449643 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-8a8fc355-95eb-4e61-8c5d-7c1b25c8ee47 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:09.531226 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] Attempting to bind port 6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4 on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:21:09.531596 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] Attempting to bind port 6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4 by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}] {{(pid=91766) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:21:09.531945 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] Attempting to bind port 6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4 on network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:21:09.542489 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d376f11-0bf2-4249-bf15-9e7aea789c45 None None] Pushing event updated for resources: {'Port': ['ID=6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4,revision_number=2']} {{(pid=91766) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:09.546525 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 21, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:21:09.547003 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] Checking segment: {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91766) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:09.547328 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:09.547684 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] Bound using segment: {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'} {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:21:09.548212 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] Bound port: 6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}}] {{(pid=91766) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:21:09.548583 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:09.551848 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:09.571054 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.provisioning_blocks [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Transition to ACTIVE for port object 27a83f61-e253-4ba1-954c-e810e9a33917 will not be triggered until provisioned by entity DHCP. {{(pid=91763) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:09.584335 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d376f11-0bf2-4249-bf15-9e7aea789c45 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:09.585050 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d376f11-0bf2-4249-bf15-9e7aea789c45 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:09.585472 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d376f11-0bf2-4249-bf15-9e7aea789c45 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:09.585829 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d376f11-0bf2-4249-bf15-9e7aea789c45 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:09.586157 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d376f11-0bf2-4249-bf15-9e7aea789c45 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:09.586478 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d376f11-0bf2-4249-bf15-9e7aea789c45 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:09.586796 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d376f11-0bf2-4249-bf15-9e7aea789c45 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:09.587111 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d376f11-0bf2-4249-bf15-9e7aea789c45 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:09.587447 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d376f11-0bf2-4249-bf15-9e7aea789c45 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:09.587768 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d376f11-0bf2-4249-bf15-9e7aea789c45 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:09.588070 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d376f11-0bf2-4249-bf15-9e7aea789c45 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:09.588563 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d376f11-0bf2-4249-bf15-9e7aea789c45 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:09.592590 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-3d376f11-0bf2-4249-bf15-9e7aea789c45 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:09.600030 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:09.604304 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-884c95a4-1b55-4103-bf03-13f226c8c08d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:09.652713 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.db [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] For port 6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91766) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:21:09.656730 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.db [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] For port 6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91766) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:21:09.661182 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:09.666076 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:09.668195 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Network 5b237728-dc31-4203-bbac-66ce3db1593a is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:21:09.670993 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:09.674741 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:21:09.675205 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-16627828'] for router_interface, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:09.751294 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Pushing event updated for resources: {'Port': ['ID=27a83f61-e253-4ba1-954c-e810e9a33917,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:09.755387 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:09.775998 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] Routers {'80126872-1960-4f13-9ca2-0eaf66181e32'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:21:09.776987 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426ffc0a0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:21:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['80126872-1960-4f13-9ca2-0eaf66181e32'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:09.834497 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:09.925869 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d376f11-0bf2-4249-bf15-9e7aea789c45 None None] Pushing event updated for resources: {'Port': ['ID=6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4,revision_number=3']} {{(pid=91766) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:09.933255 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-3d376f11-0bf2-4249-bf15-9e7aea789c45 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.267s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:10.036861 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4becd59-896c-4b5f-92dd-855eea5ba467 req-d0b57d94-aff2-403a-a23b-ae47f6579912 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:10.038588 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d4becd59-896c-4b5f-92dd-855eea5ba467 req-d0b57d94-aff2-403a-a23b-ae47f6579912 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.1366248
May 31 16:21:10.095769 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-95f2fc0e-30d7-41a6-aec3-52b7243028ef None None] Provisioning for port 27a83f61-e253-4ba1-954c-e810e9a33917 completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:21:10.103622 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d4becd59-896c-4b5f-92dd-855eea5ba467 req-cf8150be-7d00-41ae-b514-b77b509ccc0c tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0570524
May 31 16:21:10.108852 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-95f2fc0e-30d7-41a6-aec3-52b7243028ef None None] Provisioning complete for port 27a83f61-e253-4ba1-954c-e810e9a33917 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:10.109045 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-95f2fc0e-30d7-41a6-aec3-52b7243028ef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:10.118977 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] Set router 80126872-1960-4f13-9ca2-0eaf66181e32 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:21:10.171491 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:10.179418 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:10.180613 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-16310860', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-16627929'] for router_interface, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:10.198477 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:10.246312 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-95f2fc0e-30d7-41a6-aec3-52b7243028ef None None] Port 27a83f61-e253-4ba1-954c-e810e9a33917 cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:21:10.293212 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4ac819fa-f48f-4912-9a42-2341907901d1 req-9e2a1c8a-aff8-403e-a352-2db7a4ec4824 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 210 time: 0.0623798
May 31 16:21:10.486469 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Pushing event updated for resources: {'Port': ['ID=27a83f61-e253-4ba1-954c-e810e9a33917,revision_number=2']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:10.494613 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.296s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:10.544874 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426ffc0a0>, [{'id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229'}], 'enable_snat': True}, 'gw_port_id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:05Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 4, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'gw_port': {'id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:b8:5a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:06Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '27a83f61-e253-4ba1-954c-e810e9a33917', 'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'mac_address': 'fa:16:3e:fc:8a:6f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_interface', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:09Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 1, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'subnets': [{'id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:10.550033 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-330f6646-3ab0-40f7-92df-b3688c2ec13b None None] The sync data for ids ['80126872-1960-4f13-9ca2-0eaf66181e32'] in dv-cinder-793814-1-iscsi is: [{'id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229'}], 'enable_snat': True}, 'gw_port_id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:05Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 4, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'gw_port': {'id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:b8:5a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:06Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '27a83f61-e253-4ba1-954c-e810e9a33917', 'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'mac_address': 'fa:16:3e:fc:8a:6f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_interface', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:09Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 1, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'subnets': [{'id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:21:10.565362 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Network 5b237728-dc31-4203-bbac-66ce3db1593a is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:21:10.566819 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:10.810613 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Router 80126872-1960-4f13-9ca2-0eaf66181e32 has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91763) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:21:10.853401 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:10.881721 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-c4d7d476-9b5f-4657-bebb-94bd6d5f5faf None None] Provisioning complete for port 27a83f61-e253-4ba1-954c-e810e9a33917 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:10.882091 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-c4d7d476-9b5f-4657-bebb-94bd6d5f5faf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:10.941811 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-c4d7d476-9b5f-4657-bebb-94bd6d5f5faf None None] Port 27a83f61-e253-4ba1-954c-e810e9a33917 cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:21:11.035407 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:21:11.046726 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] 10.222.0.43 "PUT /v2.0/routers/80126872-1960-4f13-9ca2-0eaf66181e32/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.9103668
May 31 16:21:11.344509 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83d4cdfb-ff8e-4523-88e8-4dbace90a3a7 req-9e1382d0-52a8-4437-86c7-95561cbabce3 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:11.346889 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-83d4cdfb-ff8e-4523-88e8-4dbace90a3a7 req-9e1382d0-52a8-4437-86c7-95561cbabce3 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.1017075
May 31 16:21:11.406142 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-83d4cdfb-ff8e-4523-88e8-4dbace90a3a7 req-ce236421-9975-4943-a2fb-9d2b83978dfe tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0522809
May 31 16:21:11.559850 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7a7101dd-4789-4b6c-b1ba-1a5afd7dcc7b req-fca0654f-329e-40bd-823f-ed30eb9bd728 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 210 time: 0.0488086
May 31 16:21:11.736946 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59014) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:11.743391 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-9966473-network', 'tenant_id': 'd632158d834f4af7851eaec17fb0b06f'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:11.749105 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:11.753423 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Usage tracker for resource:network and tenant:d632158d834f4af7851eaec17fb0b06f is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:11.756714 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:11.763845 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:11.776184 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Made reservation on behalf of d632158d834f4af7851eaec17fb0b06f for: {'network': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:21:11.779119 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-639279'] for network, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:11.796468 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:11.813234 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:11.818789 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Usage tracker for resource:security_group_rule and tenant:d632158d834f4af7851eaec17fb0b06f is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:11.821428 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:11.830458 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:11.947426 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:11.952492 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:11.955703 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-65f75c24-2887-4cdb-af62-1c0e691af622 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:11.985879 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 826}  {{(pid=91763) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 31 16:21:11.997476 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=86169464-e9de-4997-a4b4-9fdec28e2439,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:12.014750 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:12.017760 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:12.018103 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.segments_db [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Added segment 82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996 of type vlan for network 1148d900-6e78-4b1c-b565-d533f8532051
May 31 16:21:12.050582 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732784079930'] for network, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:12.085763 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366'] for network, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:12.087126 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:12.087714 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:12.091369 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:12.164854 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:21:12.197273 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.4591477
May 31 16:21:12.201069 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Pushing event updated for resources: {'Network': ['ID=1148d900-6e78-4b1c-b565-d533f8532051,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:12.201927 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 59020) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:12.204460 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:12.210820 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-53e989af-6eb1-4af3-a093-09d502c67630 admin admin] Request body: {'subnet': {'network_id': '1148d900-6e78-4b1c-b565-d533f8532051', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-9966473-subnet', 'tenant_id': 'd632158d834f4af7851eaec17fb0b06f', 'ip_version': 4}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:12.214222 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Network 1148d900-6e78-4b1c-b565-d533f8532051 details requested by agent ovs-agent-dv-cinder-793814-1-iscsi with host dv-cinder-793814-1-iscsi {{(pid=91765) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 31 16:21:12.217972 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-53e989af-6eb1-4af3-a093-09d502c67630 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:12.222996 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-53e989af-6eb1-4af3-a093-09d502c67630 admin admin] Usage tracker for resource:subnet and tenant:d632158d834f4af7851eaec17fb0b06f is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:12.226591 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-53e989af-6eb1-4af3-a093-09d502c67630 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:12.235453 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-53e989af-6eb1-4af3-a093-09d502c67630 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:12.264637 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-53e989af-6eb1-4af3-a093-09d502c67630 admin admin] Made reservation on behalf of d632158d834f4af7851eaec17fb0b06f for: {'subnet': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:21:12.270180 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-53e989af-6eb1-4af3-a093-09d502c67630 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:12.379672 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-4dedc8ce-ca68-4aab-9f4b-3308a610e0f0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Request body: {'port': {'device_id': '6030e04e-d246-465d-8374-4d11b6a0ecb7', 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2', 'admin_state_up': True, 'tenant_id': '0eb6e65b3f844417816fb1e5c88a8004'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:12.693183 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:12.773067 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port 6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:21:12.778010 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:12.778392 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:12.816455 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-4dedc8ce-ca68-4aab-9f4b-3308a610e0f0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:12.836354 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-af431b14-ef02-4788-9345-c1317966df66 req-32ef385e-1cc9-4096-b2d4-5707d875b0d3 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 210 time: 0.1135862
May 31 16:21:12.847376 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-4dedc8ce-ca68-4aab-9f4b-3308a610e0f0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Usage tracker for resource:port and tenant:0eb6e65b3f844417816fb1e5c88a8004 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:12.863595 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e36546c7-28ef-4088-8566-653ad6a4fd7f req-8b9b739c-ac6c-4f9e-9cb0-0a16d14dc5ba service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.4431803
May 31 16:21:12.866033 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-4dedc8ce-ca68-4aab-9f4b-3308a610e0f0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Quota usage for port was recalculated. Used quota:1. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:12.878389 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-4dedc8ce-ca68-4aab-9f4b-3308a610e0f0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:12.899461 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9d46b82-cd1c-43a3-8a20-4568fb549efc req-af918d70-983d-48c3-8bd0-2557c1f93443 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:12.901386 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f9d46b82-cd1c-43a3-8a20-4568fb549efc req-af918d70-983d-48c3-8bd0-2557c1f93443 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.3627982
May 31 16:21:12.965933 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] Sync routers for ids ['80126872-1960-4f13-9ca2-0eaf66181e32'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:21:12.976419 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-4dedc8ce-ca68-4aab-9f4b-3308a610e0f0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Made reservation on behalf of 0eb6e65b3f844417816fb1e5c88a8004 for: {'port': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:21:12.980313 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-4dedc8ce-ca68-4aab-9f4b-3308a610e0f0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:12.984378 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] Routers {'80126872-1960-4f13-9ca2-0eaf66181e32'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:21:12.985225 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f142632cf40>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:21:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['80126872-1960-4f13-9ca2-0eaf66181e32'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:13.062941 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:13.102941 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port 6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:21:13.159271 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:13.170451 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f9d46b82-cd1c-43a3-8a20-4568fb549efc req-f0b03150-d95a-4650-b058-8a83c19ef2da tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2577829
May 31 16:21:13.170674 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:13.268883 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] Set router 80126872-1960-4f13-9ca2-0eaf66181e32 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:21:13.315347 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:13.327534 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:13.327915 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e36546c7-28ef-4088-8566-653ad6a4fd7f req-64d5ef20-8fe3-49e1-a1ea-1d4004cbf950 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:13.329384 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e36546c7-28ef-4088-8566-653ad6a4fd7f req-64d5ef20-8fe3-49e1-a1ea-1d4004cbf950 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=0eb6e65b3f844417816fb1e5c88a8004&device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 1098 time: 0.3258839
May 31 16:21:13.453050 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-4dedc8ce-ca68-4aab-9f4b-3308a610e0f0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Allocated IP 172.20.0.3 (1097eeec-06a4-406d-ab4a-02e0123072d2/68c4d303-4299-4977-888e-57c80b8530cc/a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:21:13.573910 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e36546c7-28ef-4088-8566-653ad6a4fd7f req-d643acc9-457b-4720-8699-4d66bc70bf0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:13.575383 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e36546c7-28ef-4088-8566-653ad6a4fd7f req-d643acc9-457b-4720-8699-4d66bc70bf0d service neutron] 10.222.0.63 "GET /v2.0/networks?id=1097eeec-06a4-406d-ab4a-02e0123072d2 HTTP/1.1" status: 200  len: 915 time: 0.2222810
May 31 16:21:13.693834 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f142632cf40>, [{'id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229'}], 'enable_snat': True}, 'gw_port_id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:05Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 4, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'gw_port': {'id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:b8:5a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:06Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '27a83f61-e253-4ba1-954c-e810e9a33917', 'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'mac_address': 'fa:16:3e:fc:8a:6f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_interface', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:09Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 2, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'subnets': [{'id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:13.699840 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] Checking router: 80126872-1960-4f13-9ca2-0eaf66181e32 for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:21:13.700294 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] Updating router 80126872-1960-4f13-9ca2-0eaf66181e32 port 27a83f61-e253-4ba1-954c-e810e9a33917 binding host dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 31 16:21:13.767291 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:13.776330 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e36546c7-28ef-4088-8566-653ad6a4fd7f req-3e270660-90f8-4c36-ace6-d31fdb507011 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=5591c8db-5905-4285-84f7-5743de100fc2 HTTP/1.1" status: 200  len: 217 time: 0.1783781
May 31 16:21:13.973574 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-53e989af-6eb1-4af3-a093-09d502c67630 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357'] for subnet, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:14.051671 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:14.181762 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e36546c7-28ef-4088-8566-653ad6a4fd7f req-accb33a7-0b82-4003-a468-2bf71855bbba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:14.184029 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e36546c7-28ef-4088-8566-653ad6a4fd7f req-accb33a7-0b82-4003-a468-2bf71855bbba service neutron] 10.222.0.63 "GET /v2.0/subnets?id=68c4d303-4299-4977-888e-57c80b8530cc HTTP/1.1" status: 200  len: 854 time: 0.3924675
May 31 16:21:14.238107 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-891854a8-a14b-4d72-9870-ec74ef3ceaab req-bd8f6990-8c46-404b-92c2-32ec517f8d0f tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 210 time: 0.2033803
May 31 16:21:14.268959 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e36546c7-28ef-4088-8566-653ad6a4fd7f req-7a9de35c-84a1-40fb-992f-b7db409555e1 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=1097eeec-06a4-406d-ab4a-02e0123072d2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0636656
May 31 16:21:14.317019 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-4dedc8ce-ca68-4aab-9f4b-3308a610e0f0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:14.419312 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53e989af-6eb1-4af3-a093-09d502c67630 admin admin] Pushing event updated for resources: {'Subnet': ['ID=fbc4ea0f-be4f-4d1c-a5f9-9c05726a34ab,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:14.439367 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-53e989af-6eb1-4af3-a093-09d502c67630 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.388s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:14.440675 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53e989af-6eb1-4af3-a093-09d502c67630 admin admin] Checking segment: {'id': '82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 826, 'network_id': '1148d900-6e78-4b1c-b565-d533f8532051'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:14.441359 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53e989af-6eb1-4af3-a093-09d502c67630 admin admin] Network hostable DHCP agents. Network: 1148d900-6e78-4b1c-b565-d533f8532051, hostable agents: ['5c9859e8-5965-4c86-8b2b-8fab235cbf66'], hosted agents: [] {{(pid=91764) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 31 16:21:14.459720 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] Notify callbacks [] for port, precommit_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:14.479868 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] Transition to ACTIVE for port object 27a83f61-e253-4ba1-954c-e810e9a33917 will not be triggered until provisioned by entity L2. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:14.488234 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:14.496215 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:14.563532 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53e989af-6eb1-4af3-a093-09d502c67630 admin admin] Network 1148d900-6e78-4b1c-b565-d533f8532051 is scheduled to be hosted by DHCP agent 5c9859e8-5965-4c86-8b2b-8fab235cbf66 with binding_index 1 {{(pid=91764) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 31 16:21:14.603071 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-53e989af-6eb1-4af3-a093-09d502c67630 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793814-1-iscsi, 1148d900-6e78-4b1c-b565-d533f8532051) {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:14.622333 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-53e989af-6eb1-4af3-a093-09d502c67630 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:14.623341 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-53e989af-6eb1-4af3-a093-09d502c67630 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:14.649436 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e36546c7-28ef-4088-8566-653ad6a4fd7f req-4584503b-bbbd-4fe6-a3a7-1fa3632807e4 service neutron] 10.222.0.63 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3580589
May 31 16:21:14.719385 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-4dedc8ce-ca68-4aab-9f4b-3308a610e0f0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:14.731728 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-53e989af-6eb1-4af3-a093-09d502c67630 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 2.5271771
May 31 16:21:14.734961 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59104) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:14.741584 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b92d3c7a-f978-475d-98e3-5cfab76f8b03 None None] Network 1148d900-6e78-4b1c-b565-d533f8532051 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:21:14.745024 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-9966473-router', 'tenant_id': 'd632158d834f4af7851eaec17fb0b06f', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:14.759997 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:14.777988 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Usage tracker for resource:router and tenant:d632158d834f4af7851eaec17fb0b06f is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:14.784888 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:14.826415 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:14.851306 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-16623804', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-697'] for router, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:14.852640 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:14.853652 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-16618684', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-16621667', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-16430734', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-672'] for router, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:14.885551 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:14.902145 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:14.910435 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['5591c8db-5905-4285-84f7-5743de100fc2'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:21:15.030421 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69178ddc-d5f9-4c6d-b95b-4aa6d60d525d req-c4cc5066-6945-469d-be3b-d0cce98faab7 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:15.032065 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-69178ddc-d5f9-4c6d-b95b-4aa6d60d525d req-c4cc5066-6945-469d-be3b-d0cce98faab7 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.5802341
May 31 16:21:15.037604 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-4dedc8ce-ca68-4aab-9f4b-3308a610e0f0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Network 1097eeec-06a4-406d-ab4a-02e0123072d2 is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:21:15.043088 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dedc8ce-ca68-4aab-9f4b-3308a610e0f0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Pushing event updated for resources: {'Port': ['ID=a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:15.045771 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-4dedc8ce-ca68-4aab-9f4b-3308a610e0f0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:15.051479 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-4dedc8ce-ca68-4aab-9f4b-3308a610e0f0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:15.065441 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-4dedc8ce-ca68-4aab-9f4b-3308a610e0f0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:21:15.072127 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-4dedc8ce-ca68-4aab-9f4b-3308a610e0f0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:15.072751 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-4dedc8ce-ca68-4aab-9f4b-3308a610e0f0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:15.092291 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f19e1463-1c08-4ed2-be05-108c08d82783 None None] Pushing event updated for resources: {'Port': ['ID=27a83f61-e253-4ba1-954c-e810e9a33917,revision_number=3']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:15.129519 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-f19e1463-1c08-4ed2-be05-108c08d82783 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.633s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:15.154137 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-4dedc8ce-ca68-4aab-9f4b-3308a610e0f0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.63 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.7790546
May 31 16:21:15.159415 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e36546c7-28ef-4088-8566-653ad6a4fd7f req-8ed3fb13-dd34-404b-88a8-5ff0462d5658 service neutron] 10.222.0.63 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5086360
May 31 16:21:15.164974 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-69178ddc-d5f9-4c6d-b95b-4aa6d60d525d req-92d70b4a-402a-48cc-afd1-11c4badfe447 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1114535
May 31 16:21:15.209814 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Request body: {'port': {'device_id': '6030e04e-d246-465d-8374-4d11b6a0ecb7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79381'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:15.212960 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] Attempting to bind port 27a83f61-e253-4ba1-954c-e810e9a33917 on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:21:15.214995 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] Attempting to bind port 27a83f61-e253-4ba1-954c-e810e9a33917 by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': 'fb1fd409-498f-4f29-82bc-1d244a7a3ed1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a'}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:21:15.215584 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] Attempting to bind port 27a83f61-e253-4ba1-954c-e810e9a33917 on network 5b237728-dc31-4203-bbac-66ce3db1593a {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:21:15.227198 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:15.227816 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:15.272569 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16621638', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16623758', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-722'] for router, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:15.282412 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 21, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:21:15.282808 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] Checking segment: {'id': 'fb1fd409-498f-4f29-82bc-1d244a7a3ed1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91765) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:15.283221 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:15.284020 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] Bound using segment: {'id': 'fb1fd409-498f-4f29-82bc-1d244a7a3ed1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a'} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:21:15.284449 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] Bound port: 27a83f61-e253-4ba1-954c-e810e9a33917, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb1fd409-498f-4f29-82bc-1d244a7a3ed1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a'}}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:21:15.284841 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:15.481092 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:15.622949 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2381632-70ca-446e-a5ba-56128a6e73dd req-c249cf16-9a06-48d4-b989-0cec2373fc49 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:15.624268 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-b2381632-70ca-446e-a5ba-56128a6e73dd req-c249cf16-9a06-48d4-b989-0cec2373fc49 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Synchronizing usage tracker for tenant:0eb6e65b3f844417816fb1e5c88a8004 on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:21:15.668912 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-b2381632-70ca-446e-a5ba-56128a6e73dd req-c249cf16-9a06-48d4-b989-0cec2373fc49 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Unset dirty status for tenant:0eb6e65b3f844417816fb1e5c88a8004 on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:21:15.670972 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b2381632-70ca-446e-a5ba-56128a6e73dd req-c249cf16-9a06-48d4-b989-0cec2373fc49 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 931 time: 0.2753811
May 31 16:21:15.768689 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp87ca72be-1027-56d4-a8d3-ba9dae998815-1148d900-6e78-4b1c-b565-d533f8532051', 'network_id': '1148d900-6e78-4b1c-b565-d533f8532051', 'tenant_id': 'd632158d834f4af7851eaec17fb0b06f', 'fixed_ips': [{'subnet_id': 'fbc4ea0f-be4f-4d1c-a5f9-9c05726a34ab'}]}} from dv-cinder-793814-1-iscsi. {{(pid=91765) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 31 16:21:15.772221 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:15.805499 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:15.807524 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b2381632-70ca-446e-a5ba-56128a6e73dd req-e883a4b1-41f0-477f-8e9c-d4b851bcf8ea tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1145651
May 31 16:21:15.878465 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] For port 27a83f61-e253-4ba1-954c-e810e9a33917, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91765) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:21:15.977857 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] For port 27a83f61-e253-4ba1-954c-e810e9a33917, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=27a83f61-e253-4ba1-954c-e810e9a33917,segment=NetworkSegment(fb1fd409-498f-4f29-82bc-1d244a7a3ed1),segment_id=fb1fd409-498f-4f29-82bc-1d244a7a3ed1)] {{(pid=91765) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:21:16.031991 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 {{(pid=91764) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:21:16.069433 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:16.094555 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:16.129285 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.provisioning_blocks [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Transition to ACTIVE for port object a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 will not be triggered until provisioned by entity L2. {{(pid=91764) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:16.137492 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:16.170018 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:16.183682 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:16.206949 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:16.466956 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Allocated IP 172.27.0.177 (00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c/96709d85-d0fe-4cf8-b232-eaf6b143ebe6/5f8286e6-a0de-4023-a9eb-6eeb4f27b09f) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:21:16.484849 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Pushing event updated for resources: {'Port': ['ID=a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9,revision_number=2']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:16.504689 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.344s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:16.644591 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] Routers {'80126872-1960-4f13-9ca2-0eaf66181e32'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:21:16.645392 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f142632cf40>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:21:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['80126872-1960-4f13-9ca2-0eaf66181e32'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:16.727332 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 59142) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:16.756990 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.db_base_plugin_common [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Allocated IP 172.20.0.2 (1148d900-6e78-4b1c-b565-d533f8532051/fbc4ea0f-be4f-4d1c-a5f9-9c05726a34ab/4af2bd35-f462-4d40-b558-8366735d7a77) {{(pid=91765) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:21:16.799387 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Attempting to bind port a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 on host hv-cinder-79381 for vnic_type normal with profile  {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:21:16.799946 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Attempting to bind port a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 by drivers openvswitch,hyperv on host hv-cinder-79381 at level 0 using segments [{'id': '016e9daa-b906-4ec8-978d-cb58fbcd78da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2'}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:21:16.800384 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Attempting to bind port a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 on network 1097eeec-06a4-406d-ab4a-02e0123072d2 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:21:16.807244 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Port a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 on network 1097eeec-06a4-406d-ab4a-02e0123072d2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79381 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 31 16:21:16.807726 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Attempting to bind port a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 on network 1097eeec-06a4-406d-ab4a-02e0123072d2 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:21:16.814292 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Checking agent: {'id': '4bed2638-4d91-4afb-bf81-aacca8584621', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79381', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'started_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 20, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:21:16.814845 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Checking segment: {'id': '016e9daa-b906-4ec8-978d-cb58fbcd78da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:16.815634 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Bound using segment: {'id': '016e9daa-b906-4ec8-978d-cb58fbcd78da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2'} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:21:16.815990 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Bound port: a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9, host: hv-cinder-79381, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '016e9daa-b906-4ec8-978d-cb58fbcd78da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2'}}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:21:16.816591 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:16.826389 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:16.868223 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:16.891764 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:17.014304 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:21:17.018327 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:17.023315 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:21:17.027273 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f19e1463-1c08-4ed2-be05-108c08d82783 None None] Pushing event updated for resources: {'Port': ['ID=27a83f61-e253-4ba1-954c-e810e9a33917,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:17.056870 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-f19e1463-1c08-4ed2-be05-108c08d82783 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.850s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:17.082208 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-0799be5e-f793-4fa5-9d80-3f38339b7e4e admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:17.094081 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Pushing event updated for resources: {'Port': ['ID=5f8286e6-a0de-4023-a9eb-6eeb4f27b09f,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:17.105492 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.214s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:17.109945 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06b41f5d-288f-4a2b-945f-afcaa5007047 req-4df194eb-0485-4635-a7b0-502f350e1d19 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:17.111451 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-06b41f5d-288f-4a2b-945f-afcaa5007047 req-4df194eb-0485-4635-a7b0-502f350e1d19 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.2697849
May 31 16:21:17.112556 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] For port a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9, host hv-cinder-79381, cleared binding levels {{(pid=91764) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:21:17.140725 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-0799be5e-f793-4fa5-9d80-3f38339b7e4e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:17.143848 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] For port a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9, host hv-cinder-79381, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9,segment=NetworkSegment(016e9daa-b906-4ec8-978d-cb58fbcd78da),segment_id=016e9daa-b906-4ec8-978d-cb58fbcd78da)] {{(pid=91764) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:21:17.160116 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-0799be5e-f793-4fa5-9d80-3f38339b7e4e admin admin] Usage tracker for resource:security_group_rule and tenant:39c0d281f01649749b46895fdccb2418 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:17.167414 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:17.168409 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-0799be5e-f793-4fa5-9d80-3f38339b7e4e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:17.190898 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-0799be5e-f793-4fa5-9d80-3f38339b7e4e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:17.196053 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:17.261074 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] Set router 80126872-1960-4f13-9ca2-0eaf66181e32 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:21:17.263054 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:17.263663 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:17.265577 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] 10.222.0.63 "PUT /v2.0/ports/a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 HTTP/1.1" status: 200  len: 1093 time: 2.0745411
May 31 16:21:17.276331 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6030e04e-d246-465d-8374-4d11b6a0ecb7', 'tag': 'a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:21:17.279658 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8b505645-7b77-4db7-8bec-18a597671062" -d '{"events": [{"name": "network-changed", "server_uuid": "6030e04e-d246-465d-8374-4d11b6a0ecb7", "tag": "a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:21:17.284451 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-06b41f5d-288f-4a2b-945f-afcaa5007047 req-9319860b-c339-496c-affc-a886c10727ce tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1631625
May 31 16:21:17.336747 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Pushing event updated for resources: {'Port': ['ID=a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9,revision_number=3']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:17.340308 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:17.359079 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea27f723-5e74-447a-9b00-dbd9d1fd2385 req-589e9628-eb9c-458e-bf46-3c8ef3f44434 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:17.368066 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ea27f723-5e74-447a-9b00-dbd9d1fd2385 req-589e9628-eb9c-458e-bf46-3c8ef3f44434 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 943 time: 0.3599494
May 31 16:21:17.432122 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Notify callbacks [] for port, precommit_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:17.467253 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:21:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f44f86ea-f17d-4b15-ba19-819b6eaa3d42 x-openstack-request-id: req-f44f86ea-f17d-4b15-ba19-819b6eaa3d42 {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:21:17.467697 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6030e04e-d246-465d-8374-4d11b6a0ecb7", "tag": "a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:21:17.468038 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-f44f86ea-f17d-4b15-ba19-819b6eaa3d42 {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:21:17.468596 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6030e04e-d246-465d-8374-4d11b6a0ecb7', 'tag': 'a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9', 'status': 'completed', 'code': 200}
May 31 16:21:17.493290 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:17.505611 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Transition to ACTIVE for port object 4af2bd35-f462-4d40-b558-8366735d7a77 will not be triggered until provisioned by entity L2. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:17.526724 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-0799be5e-f793-4fa5-9d80-3f38339b7e4e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:17.544515 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Transition to ACTIVE for port object 4af2bd35-f462-4d40-b558-8366735d7a77 will not be triggered until provisioned by entity DHCP. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:17.562231 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:17.562468 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ea27f723-5e74-447a-9b00-dbd9d1fd2385 req-02fffede-fb98-4735-8368-6e5439c14e5d tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1933603
May 31 16:21:17.563117 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-0799be5e-f793-4fa5-9d80-3f38339b7e4e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:17.569356 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:17.575299 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-5e0fe959-cba8-4ec0-bbcb-a3f26ed9efa0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:17.636311 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0799be5e-f793-4fa5-9d80-3f38339b7e4e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fa0acdb7-a08f-4434-9c38-8ea27629885e,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:17.647483 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-0799be5e-f793-4fa5-9d80-3f38339b7e4e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:17.651107 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Network 1148d900-6e78-4b1c-b565-d533f8532051 is already hosted by enough agents. {{(pid=91765) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:21:17.655581 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.scheduler.base_scheduler [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Resources bound (agent type, host, resource id):  {{(pid=91765) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:17.656313 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-0799be5e-f793-4fa5-9d80-3f38339b7e4e admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=39c0d281f01649749b46895fdccb2418&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8929093
May 31 16:21:17.664251 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 59164) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:17.683962 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-c4158897-3fd4-4958-932a-27142de29f1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:17.685033 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Received port after_create {{(pid=91765) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:21:17.685917 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-c4158897-3fd4-4958-932a-27142de29f1e service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=0eb6e65b3f844417816fb1e5c88a8004&device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 1096 time: 0.2962167
May 31 16:21:17.728559 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Pushing event updated for resources: {'Port': ['ID=4af2bd35-f462-4d40-b558-8366735d7a77,revision_number=1']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:17.737007 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:17.801281 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Attempting to bind port 4af2bd35-f462-4d40-b558-8366735d7a77 on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:21:17.801625 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Attempting to bind port 4af2bd35-f462-4d40-b558-8366735d7a77 by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 826, 'network_id': '1148d900-6e78-4b1c-b565-d533f8532051'}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:21:17.801991 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Attempting to bind port 4af2bd35-f462-4d40-b558-8366735d7a77 on network 1148d900-6e78-4b1c-b565-d533f8532051 {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:21:17.803353 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-98b19784-05cc-4be0-a92d-970e0196b035 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 HTTP/1.1" status: 200  len: 217 time: 0.0738358
May 31 16:21:17.810446 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 21, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:21:17.810644 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Checking segment: {'id': '82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 826, 'network_id': '1148d900-6e78-4b1c-b565-d533f8532051'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91765) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:17.811038 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:17.811441 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Bound using segment: {'id': '82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 826, 'network_id': '1148d900-6e78-4b1c-b565-d533f8532051'} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:21:17.811928 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Bound port: 4af2bd35-f462-4d40-b558-8366735d7a77, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 826, 'network_id': '1148d900-6e78-4b1c-b565-d533f8532051'}}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:21:17.812313 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:17.866395 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-8221d3c6-24fe-496f-a5d8-4035c543608d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:17.905846 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-34181eb1-a77f-4ee3-8426-577a56919cc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:17.907193 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-34181eb1-a77f-4ee3-8426-577a56919cc1 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=68c4d303-4299-4977-888e-57c80b8530cc HTTP/1.1" status: 200  len: 854 time: 0.0936370
May 31 16:21:17.908876 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f142632cf40>, [{'id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229'}], 'enable_snat': True}, 'gw_port_id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:05Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 4, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'gw_port': {'id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:b8:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:06Z', 'updated_at': '2021-05-31T16:21:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '27a83f61-e253-4ba1-954c-e810e9a33917', 'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'mac_address': 'fa:16:3e:fc:8a:6f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_interface', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:09Z', 'updated_at': '2021-05-31T16:21:15Z', 'revision_number': 4, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'subnets': [{'id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:17.909072 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-8221d3c6-24fe-496f-a5d8-4035c543608d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:17.917328 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19e5e8b1-1d72-4457-8771-608934990780 None None] The sync data for ids ['80126872-1960-4f13-9ca2-0eaf66181e32'] in dv-cinder-793814-1-iscsi is: [{'id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229'}], 'enable_snat': True}, 'gw_port_id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:05Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 4, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'gw_port': {'id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:b8:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:06Z', 'updated_at': '2021-05-31T16:21:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '27a83f61-e253-4ba1-954c-e810e9a33917', 'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'mac_address': 'fa:16:3e:fc:8a:6f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_interface', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:09Z', 'updated_at': '2021-05-31T16:21:15Z', 'revision_number': 4, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'subnets': [{'id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:21:17.929336 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] For port 4af2bd35-f462-4d40-b558-8366735d7a77, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91765) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:21:17.932365 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-16623797', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16621573'] for router, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:17.932908 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] For port 4af2bd35-f462-4d40-b558-8366735d7a77, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=4af2bd35-f462-4d40-b558-8366735d7a77,segment=NetworkSegment(82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996),segment_id=82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996)] {{(pid=91765) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:21:17.945655 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:17.950349 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-12ca662b-0453-433c-a772-dfcc66e15ab6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:17.974396 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-4528e5e4-fa51-4c71-8ad3-9d5a33f0cda3 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=1097eeec-06a4-406d-ab4a-02e0123072d2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0567684
May 31 16:21:18.095689 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Pushing event updated for resources: {'Port': ['ID=4af2bd35-f462-4d40-b558-8366735d7a77,revision_number=2']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:18.101657 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:18.232748 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-024b6668-bef6-4fac-b5b2-56f850f54b76 service neutron] 10.222.0.63 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2462077
May 31 16:21:18.233556 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-8221d3c6-24fe-496f-a5d8-4035c543608d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:18.241730 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:18.259186 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-8221d3c6-24fe-496f-a5d8-4035c543608d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:18.260475 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-8221d3c6-24fe-496f-a5d8-4035c543608d admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/fa0acdb7-a08f-4434-9c38-8ea27629885e HTTP/1.1" status: 204  len: 168 time: 0.5912278
May 31 16:21:18.344602 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Router bdad89a7-282d-4ae9-8124-6eabc155bcbe is scheduled to L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e with binding_index 1 {{(pid=91763) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 31 16:21:18.400826 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8221d3c6-24fe-496f-a5d8-4035c543608d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fa0acdb7-a08f-4434-9c38-8ea27629885e,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:18.420268 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-8221d3c6-24fe-496f-a5d8-4035c543608d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:18.664706 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f899c5ba-0a03-4d45-bdfe-bd78debdc1d9 req-142d08a2-026e-457a-a150-0e2f91adb0c6 service neutron] 10.222.0.63 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4093864
May 31 16:21:18.883840 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:21:18.896461 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] Sync routers for ids ['bdad89a7-282d-4ae9-8124-6eabc155bcbe'] in dv-cinder-793814-1-iscsi {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:21:18.912214 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] Routers {'bdad89a7-282d-4ae9-8124-6eabc155bcbe'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:21:18.913008 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426dc0640>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:21:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['bdad89a7-282d-4ae9-8124-6eabc155bcbe'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:18.946585 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 4af2bd35-f462-4d40-b558-8366735d7a77 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:18.989201 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Notify callbacks [] for router, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:18.994742 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201  len: 921 time: 4.2542341
May 31 16:21:18.994927 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59198) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:19.158149 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port 4af2bd35-f462-4d40-b558-8366735d7a77 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:21:19.184299 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 27a83f61-e253-4ba1-954c-e810e9a33917 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:19.218684 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8934d7b3-3b7a-4d77-a213-bcdaf5d57f61 req-f90d4d8b-0d87-4d14-a813-8baf87b19485 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:19.228425 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8934d7b3-3b7a-4d77-a213-bcdaf5d57f61 req-f90d4d8b-0d87-4d14-a813-8baf87b19485 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.5556705
May 31 16:21:19.260088 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b505645-7b77-4db7-8bec-18a597671062 req-0bf41d6c-bfa8-43d4-b2a2-331f8ca2944c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:19.261840 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8b505645-7b77-4db7-8bec-18a597671062 req-0bf41d6c-bfa8-43d4-b2a2-331f8ca2944c service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=0eb6e65b3f844417816fb1e5c88a8004&device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 1096 time: 0.4956446
May 31 16:21:19.315693 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e249f070-0d5a-45f3-919c-50d0043bf00d req-ee6d0391-848e-403d-837b-c61854cd170d tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:19.325021 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e249f070-0d5a-45f3-919c-50d0043bf00d req-ee6d0391-848e-403d-837b-c61854cd170d tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 943 time: 0.3474367
May 31 16:21:19.431039 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port 27a83f61-e253-4ba1-954c-e810e9a33917 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:21:19.441197 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 27a83f61-e253-4ba1-954c-e810e9a33917 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:19.441754 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:19.456390 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] Set router bdad89a7-282d-4ae9-8124-6eabc155bcbe gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:21:19.612862 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8934d7b3-3b7a-4d77-a213-bcdaf5d57f61 req-72fd5cc4-9fa8-4c98-9409-9f3e17e814cc tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3835392
May 31 16:21:19.669971 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:19.802772 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e249f070-0d5a-45f3-919c-50d0043bf00d req-844fc465-5b1a-4630-a80f-18d849782346 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4743750
May 31 16:21:19.871740 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-afe80223-1f0f-4890-91e6-7f7cde29d30e None None] Network 1148d900-6e78-4b1c-b565-d533f8532051 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:21:19.879131 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b505645-7b77-4db7-8bec-18a597671062 req-cba83eaf-9433-4c2f-a8bc-61bd30a50a3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:19.881293 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8b505645-7b77-4db7-8bec-18a597671062 req-cba83eaf-9433-4c2f-a8bc-61bd30a50a3b service neutron] 10.222.0.63 "GET /v2.0/networks?id=1097eeec-06a4-406d-ab4a-02e0123072d2 HTTP/1.1" status: 200  len: 915 time: 0.6079180
May 31 16:21:20.116868 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8b505645-7b77-4db7-8bec-18a597671062 req-d4a37ce3-9c0a-43c4-9c26-8a4abee827a2 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 HTTP/1.1" status: 200  len: 217 time: 0.2164416
May 31 16:21:20.165570 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:20.231965 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b505645-7b77-4db7-8bec-18a597671062 req-4d48f2b7-8cf1-4a59-8ed4-607e8fb96c59 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:20.234188 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8b505645-7b77-4db7-8bec-18a597671062 req-4d48f2b7-8cf1-4a59-8ed4-607e8fb96c59 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=68c4d303-4299-4977-888e-57c80b8530cc HTTP/1.1" status: 200  len: 854 time: 0.1055629
May 31 16:21:20.273031 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426dc0640>, [{'id': 'bdad89a7-282d-4ae9-8124-6eabc155bcbe', 'name': 'tempest-TestVolumeBootPattern-9966473-router', 'tenant_id': 'd632158d834f4af7851eaec17fb0b06f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.177'}], 'enable_snat': True}, 'gw_port_id': '5f8286e6-a0de-4023-a9eb-6eeb4f27b09f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:14Z', 'updated_at': '2021-05-31T16:21:17Z', 'revision_number': 3, 'project_id': 'd632158d834f4af7851eaec17fb0b06f', 'gw_port': {'id': '5f8286e6-a0de-4023-a9eb-6eeb4f27b09f', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:f0:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bdad89a7-282d-4ae9-8124-6eabc155bcbe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 281, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:16Z', 'updated_at': '2021-05-31T16:21:16Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:20.279054 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] Checking router: bdad89a7-282d-4ae9-8124-6eabc155bcbe for host: dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:21:20.279671 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] Updating router bdad89a7-282d-4ae9-8124-6eabc155bcbe port 5f8286e6-a0de-4023-a9eb-6eeb4f27b09f binding host dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 31 16:21:20.312866 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port 27a83f61-e253-4ba1-954c-e810e9a33917, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=27a83f61-e253-4ba1-954c-e810e9a33917,segment=NetworkSegment(fb1fd409-498f-4f29-82bc-1d244a7a3ed1),segment_id=fb1fd409-498f-4f29-82bc-1d244a7a3ed1)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:21:20.313477 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8b505645-7b77-4db7-8bec-18a597671062 req-5c37fa75-5755-4552-b535-dbb8192c70ef service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=1097eeec-06a4-406d-ab4a-02e0123072d2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0715148
May 31 16:21:20.316338 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-8f7eb4b3-9633-4167-ae8a-6435b1dbbc08 None None] Provisioning for port 4af2bd35-f462-4d40-b558-8366735d7a77 completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:21:20.342814 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:20.344763 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:20.364986 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-a48ba7a3-5849-444c-a23b-5bfcd7f54059 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:20.475566 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-8f7eb4b3-9633-4167-ae8a-6435b1dbbc08 None None] Provisioning complete for port 4af2bd35-f462-4d40-b558-8366735d7a77 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:20.476173 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-8f7eb4b3-9633-4167-ae8a-6435b1dbbc08 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:20.580570 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8b505645-7b77-4db7-8bec-18a597671062 req-b6270b84-df01-48dc-88d3-9192d456173f service neutron] 10.222.0.63 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2557552
May 31 16:21:20.619705 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=27a83f61-e253-4ba1-954c-e810e9a33917,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:20.640273 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.275s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:20.792591 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:21.001884 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-8f7eb4b3-9633-4167-ae8a-6435b1dbbc08 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:21.068519 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-8f7eb4b3-9633-4167-ae8a-6435b1dbbc08 None None] For port 4af2bd35-f462-4d40-b558-8366735d7a77, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=4af2bd35-f462-4d40-b558-8366735d7a77,segment=NetworkSegment(82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996),segment_id=82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:21:21.080509 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-8f7eb4b3-9633-4167-ae8a-6435b1dbbc08 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:21.084768 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:21.116912 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] Notify callbacks [] for port, precommit_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:21.137499 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.provisioning_blocks [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] Transition to ACTIVE for port object 5f8286e6-a0de-4023-a9eb-6eeb4f27b09f will not be triggered until provisioned by entity L2. {{(pid=91766) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:21.151108 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:21.158828 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:21.310679 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8b505645-7b77-4db7-8bec-18a597671062 req-83ad5b26-9c1b-4cb6-beb0-a49e8051f43c service neutron] 10.222.0.63 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.7133987
May 31 16:21:21.334849 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f7eb4b3-9633-4167-ae8a-6435b1dbbc08 None None] Pushing event updated for resources: {'Port': ['ID=4af2bd35-f462-4d40-b558-8366735d7a77,revision_number=3']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:21.338515 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-8f7eb4b3-9633-4167-ae8a-6435b1dbbc08 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.256s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:21.377711 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de9ca701-8c8f-45be-ba50-8229710120fa req-0d6cf565-fa65-4269-8e0f-f958dfa40f3d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:21.389720 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-de9ca701-8c8f-45be-ba50-8229710120fa req-0d6cf565-fa65-4269-8e0f-f958dfa40f3d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.4275782
May 31 16:21:21.393433 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 59268) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:21.415433 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Allocated IP 172.20.0.1 (1148d900-6e78-4b1c-b565-d533f8532051/fbc4ea0f-be4f-4d1c-a5f9-9c05726a34ab/321d16c6-0236-4519-8174-ad604590b1fc) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:21:21.432059 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b318ac94-cc0e-4054-8648-7eac7c546cbf req-8c931afa-aefd-4c56-bccc-4d8efd028dc3 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:21.434193 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b318ac94-cc0e-4054-8648-7eac7c546cbf req-8c931afa-aefd-4c56-bccc-4d8efd028dc3 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 946 time: 0.4879739
May 31 16:21:21.454283 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] Attempting to bind port 5f8286e6-a0de-4023-a9eb-6eeb4f27b09f on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:21:21.458608 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] Attempting to bind port 5f8286e6-a0de-4023-a9eb-6eeb4f27b09f by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}] {{(pid=91766) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:21:21.459192 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] Attempting to bind port 5f8286e6-a0de-4023-a9eb-6eeb4f27b09f on network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:21:21.459902 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59274) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:21.468403 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 21, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:21:21.468782 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] Checking segment: {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91766) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:21.469397 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:21.470020 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] Bound using segment: {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'} {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:21:21.470671 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] Bound port: 5f8286e6-a0de-4023-a9eb-6eeb4f27b09f, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}}] {{(pid=91766) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:21:21.471262 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:21.506955 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-de9ca701-8c8f-45be-ba50-8229710120fa req-ad9ac2ab-e997-4772-bd73-7cb93b93dee8 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1151276
May 31 16:21:21.519037 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-a7b256bb-a72b-483c-8807-e5ae1ec31f0d None None] Provisioning complete for port 4af2bd35-f462-4d40-b558-8366735d7a77 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:21.519707 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-a7b256bb-a72b-483c-8807-e5ae1ec31f0d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:21.549089 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b318ac94-cc0e-4054-8648-7eac7c546cbf req-f70f5fb7-046e-4097-b16b-b76fd4a55d20 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/security-groups?id=165e01bc-53ca-416e-93c5-98db294169b6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1046553
May 31 16:21:21.567051 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e16f3546-bc9a-44ac-a3f0-0267e4fa78e1 None None] Pushing event updated for resources: {'Port': ['ID=5f8286e6-a0de-4023-a9eb-6eeb4f27b09f,revision_number=2']} {{(pid=91766) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:21.582700 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-e16f3546-bc9a-44ac-a3f0-0267e4fa78e1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.424s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:21.638893 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-31c5910f-53ec-46f1-b169-52a6bafc2962 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:21.646552 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-8cda419d-8e33-4fe1-87fb-2115236f1377 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:21.663792 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.db [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] For port 5f8286e6-a0de-4023-a9eb-6eeb4f27b09f, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91766) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:21:21.671512 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.db [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] For port 5f8286e6-a0de-4023-a9eb-6eeb4f27b09f, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=5f8286e6-a0de-4023-a9eb-6eeb4f27b09f,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91766) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:21:21.675618 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-31c5910f-53ec-46f1-b169-52a6bafc2962 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:21.680504 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:21.684837 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:21.685214 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:21.688498 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-31c5910f-53ec-46f1-b169-52a6bafc2962 admin admin] Usage tracker for resource:security_group_rule and tenant:6a30e620410b4fea8ec7a3051583df03 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:21.694689 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-31c5910f-53ec-46f1-b169-52a6bafc2962 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:21.700746 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-8cda419d-8e33-4fe1-87fb-2115236f1377 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:21.705917 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-31c5910f-53ec-46f1-b169-52a6bafc2962 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:21.712110 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-8cda419d-8e33-4fe1-87fb-2115236f1377 admin admin] Usage tracker for resource:security_group_rule and tenant:8239eb23579c419ea801fa5dc8a622a9 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:21.716434 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:21:21.717862 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.provisioning_blocks [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Transition to ACTIVE for port object 321d16c6-0236-4519-8174-ad604590b1fc will not be triggered until provisioned by entity DHCP. {{(pid=91763) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:21.726160 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-8cda419d-8e33-4fe1-87fb-2115236f1377 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:21.742490 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-8cda419d-8e33-4fe1-87fb-2115236f1377 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:21.788144 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:21.815354 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:21.835225 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] Routers {'bdad89a7-282d-4ae9-8124-6eabc155bcbe'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:21:21.835956 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426dc0640>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:21:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['bdad89a7-282d-4ae9-8124-6eabc155bcbe'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:21.887828 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e69af89-bb0e-4d38-96db-ca0daaef8bce req-50de7146-1ca1-494c-91c0-760b555653b7 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:21.890140 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1e69af89-bb0e-4d38-96db-ca0daaef8bce req-50de7146-1ca1-494c-91c0-760b555653b7 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 943 time: 0.1449227
May 31 16:21:21.913057 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Network 1148d900-6e78-4b1c-b565-d533f8532051 is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:21:21.922929 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:21.933626 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:21:21.934355 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-16627828'] for router_interface, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:21.945312 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-31c5910f-53ec-46f1-b169-52a6bafc2962 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:21.951577 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9,segment=NetworkSegment(016e9daa-b906-4ec8-978d-cb58fbcd78da),segment_id=016e9daa-b906-4ec8-978d-cb58fbcd78da)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:21:21.956618 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Pushing event updated for resources: {'Port': ['ID=321d16c6-0236-4519-8174-ad604590b1fc,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:21.961181 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-31c5910f-53ec-46f1-b169-52a6bafc2962 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:21.972921 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:21.973870 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-3809923f-2d5d-4c18-8483-b677b43e405f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:21.991473 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': 'a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9', 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2', 'port_id': 'a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9', 'mac_address': 'fa:16:3e:0e:50:6c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 838, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '68c4d303-4299-4977-888e-57c80b8530cc', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:21:21.992433 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1e69af89-bb0e-4d38-96db-ca0daaef8bce req-b4774aab-5494-45cd-bb61-f3e3766d8038 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0953102
May 31 16:21:22.026964 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-8cda419d-8e33-4fe1-87fb-2115236f1377 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:22.033951 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-8cda419d-8e33-4fe1-87fb-2115236f1377 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:22.043952 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-31c5910f-53ec-46f1-b169-52a6bafc2962 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=6a30e620410b4fea8ec7a3051583df03&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5807693
May 31 16:21:22.056403 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59280) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:22.057498 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31c5910f-53ec-46f1-b169-52a6bafc2962 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3e74e8ac-d348-4f1a-bc11-281c250b60df,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:22.070141 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-9da07832-4383-44cb-a231-e62a0718cc7f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:22.093185 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] Set router bdad89a7-282d-4ae9-8124-6eabc155bcbe gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:21:22.095315 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:22.102235 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-8cda419d-8e33-4fe1-87fb-2115236f1377 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=8239eb23579c419ea801fa5dc8a622a9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7041152
May 31 16:21:22.102235 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cda419d-8e33-4fe1-87fb-2115236f1377 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2fe68fe4-4da2-4120-af1c-1bd855676a82,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:22.103650 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 59284) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:22.106391 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-8cda419d-8e33-4fe1-87fb-2115236f1377 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:22.138245 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:21:22.163816 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9,segment=NetworkSegment(016e9daa-b906-4ec8-978d-cb58fbcd78da),segment_id=016e9daa-b906-4ec8-978d-cb58fbcd78da)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:21:22.174863 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:22.178320 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:22.181111 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-04952c73-ca57-41e0-a689-2f0c708b3c55 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:22.210968 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-04952c73-ca57-41e0-a689-2f0c708b3c55 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:22.274953 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-31c5910f-53ec-46f1-b169-52a6bafc2962 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.301s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:22.276501 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-04952c73-ca57-41e0-a689-2f0c708b3c55 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:22.278538 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:22.284738 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:22.292375 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:22.336222 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-04952c73-ca57-41e0-a689-2f0c708b3c55 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:22.342828 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-04952c73-ca57-41e0-a689-2f0c708b3c55 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/2fe68fe4-4da2-4120-af1c-1bd855676a82 HTTP/1.1" status: 204  len: 168 time: 0.2379768
May 31 16:21:22.344919 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04952c73-ca57-41e0-a689-2f0c708b3c55 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2fe68fe4-4da2-4120-af1c-1bd855676a82,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:22.354997 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-04952c73-ca57-41e0-a689-2f0c708b3c55 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:22.370025 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e16f3546-bc9a-44ac-a3f0-0267e4fa78e1 None None] Pushing event updated for resources: {'Port': ['ID=5f8286e6-a0de-4023-a9eb-6eeb4f27b09f,revision_number=3']} {{(pid=91766) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:22.373696 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-e16f3546-bc9a-44ac-a3f0-0267e4fa78e1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.688s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:22.380861 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2c3bf171-94e2-4093-a211-adc86ef7c548 None None] Provisioning for port 321d16c6-0236-4519-8174-ad604590b1fc completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:21:22.401082 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-811c779b-73ba-4785-afb0-21c531233709 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:22.424861 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2c3bf171-94e2-4093-a211-adc86ef7c548 None None] Provisioning complete for port 321d16c6-0236-4519-8174-ad604590b1fc triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:22.425250 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2c3bf171-94e2-4093-a211-adc86ef7c548 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:22.443867 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-811c779b-73ba-4785-afb0-21c531233709 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:22.474396 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426dc0640>, [{'id': 'bdad89a7-282d-4ae9-8124-6eabc155bcbe', 'name': 'tempest-TestVolumeBootPattern-9966473-router', 'tenant_id': 'd632158d834f4af7851eaec17fb0b06f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.177'}], 'enable_snat': True}, 'gw_port_id': '5f8286e6-a0de-4023-a9eb-6eeb4f27b09f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:14Z', 'updated_at': '2021-05-31T16:21:17Z', 'revision_number': 3, 'project_id': 'd632158d834f4af7851eaec17fb0b06f', 'gw_port': {'id': '5f8286e6-a0de-4023-a9eb-6eeb4f27b09f', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:f0:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bdad89a7-282d-4ae9-8124-6eabc155bcbe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 281, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:16Z', 'updated_at': '2021-05-31T16:21:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:22.478655 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7c29728-2823-4ef6-8f09-406029f42a45 None None] The sync data for ids ['bdad89a7-282d-4ae9-8124-6eabc155bcbe'] in dv-cinder-793814-1-iscsi is: [{'id': 'bdad89a7-282d-4ae9-8124-6eabc155bcbe', 'name': 'tempest-TestVolumeBootPattern-9966473-router', 'tenant_id': 'd632158d834f4af7851eaec17fb0b06f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.177'}], 'enable_snat': True}, 'gw_port_id': '5f8286e6-a0de-4023-a9eb-6eeb4f27b09f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:14Z', 'updated_at': '2021-05-31T16:21:17Z', 'revision_number': 3, 'project_id': 'd632158d834f4af7851eaec17fb0b06f', 'gw_port': {'id': '5f8286e6-a0de-4023-a9eb-6eeb4f27b09f', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:f0:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bdad89a7-282d-4ae9-8124-6eabc155bcbe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 281, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:16Z', 'updated_at': '2021-05-31T16:21:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}] {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:21:22.556955 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2c3bf171-94e2-4093-a211-adc86ef7c548 None None] Port 321d16c6-0236-4519-8174-ad604590b1fc cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:21:22.636182 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:22.731074 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:21:22.749703 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-811c779b-73ba-4785-afb0-21c531233709 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:22.754444 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:22.794598 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-811c779b-73ba-4785-afb0-21c531233709 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3e74e8ac-d348-4f1a-bc11-281c250b60df,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:22.800203 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-811c779b-73ba-4785-afb0-21c531233709 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:22.839881 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 4af2bd35-f462-4d40-b558-8366735d7a77 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:22.906437 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-811c779b-73ba-4785-afb0-21c531233709 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:22.909952 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-811c779b-73ba-4785-afb0-21c531233709 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/3e74e8ac-d348-4f1a-bc11-281c250b60df HTTP/1.1" status: 204  len: 168 time: 0.8468521
May 31 16:21:23.087929 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:23.096564 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:23.097744 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-16310860', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-16627929'] for router_interface, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:23.110921 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:23.232072 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 4af2bd35-f462-4d40-b558-8366735d7a77 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:23.232458 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:23.366896 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b79c9433-1539-46bc-9dca-db166ee2bb41 req-0ee7494d-4dcb-408b-b8df-c96c492e369b tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:23.370263 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b79c9433-1539-46bc-9dca-db166ee2bb41 req-0ee7494d-4dcb-408b-b8df-c96c492e369b tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.6037681
May 31 16:21:23.382218 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Pushing event updated for resources: {'Port': ['ID=321d16c6-0236-4519-8174-ad604590b1fc,revision_number=2']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:23.388837 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.277s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:23.493800 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0d266a-675a-4712-85eb-a21bf5144c99 req-3c752105-81f1-4fd9-8c6d-a38402239b57 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:23.496080 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cd0d266a-675a-4712-85eb-a21bf5144c99 req-3c752105-81f1-4fd9-8c6d-a38402239b57 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 946 time: 0.6472871
May 31 16:21:23.509389 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Network 1148d900-6e78-4b1c-b565-d533f8532051 is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:21:23.512323 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:23.532546 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b79c9433-1539-46bc-9dca-db166ee2bb41 req-c4372a46-5897-479a-beb0-25cdc152b9c7 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1403670
May 31 16:21:23.618940 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 27a83f61-e253-4ba1-954c-e810e9a33917 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:23.699423 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cd0d266a-675a-4712-85eb-a21bf5144c99 req-3297e710-494d-4c3f-b5c7-2f252bc30803 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/security-groups?id=165e01bc-53ca-416e-93c5-98db294169b6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1536670
May 31 16:21:23.720083 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9541691b-d5d7-4772-819c-8a360ff3fb80 req-5c97dce7-bfca-40b7-b105-6ee345394458 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:23.721955 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9541691b-d5d7-4772-819c-8a360ff3fb80 req-5c97dce7-bfca-40b7-b105-6ee345394458 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.63 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 946 time: 0.6255267
May 31 16:21:23.744813 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 27a83f61-e253-4ba1-954c-e810e9a33917 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:23.745142 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:23.929373 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Router bdad89a7-282d-4ae9-8124-6eabc155bcbe has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91763) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:21:24.059090 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-a487f1e4-edef-4ad4-be72-02f8f4e4d824 None None] Provisioning complete for port 321d16c6-0236-4519-8174-ad604590b1fc triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:24.059854 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-a487f1e4-edef-4ad4-be72-02f8f4e4d824 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:24.146158 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-a487f1e4-edef-4ad4-be72-02f8f4e4d824 None None] Port 321d16c6-0236-4519-8174-ad604590b1fc cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:21:24.210754 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [req-9541691b-d5d7-4772-819c-8a360ff3fb80 req-592dbc24-abf1-4186-ba3b-95441d90b4c7 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Deleting port 0e5a85ae-aafa-4bae-adee-5fc58eaad298 {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:21:24.211197 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-9541691b-d5d7-4772-819c-8a360ff3fb80 req-592dbc24-abf1-4186-ba3b-95441d90b4c7 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:24.261337 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59346) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:24.315052 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:21:24.329638 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] 10.222.0.43 "PUT /v2.0/routers/bdad89a7-282d-4ae9-8124-6eabc155bcbe/add_router_interface HTTP/1.1" status: 200  len: 503 time: 5.3258049
May 31 16:21:24.436882 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-475d9ce4-aea1-4d17-b69c-c1bac1e68834 req-7aa236ae-8d52-4284-8412-512151a27d90 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:24.438400 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-475d9ce4-aea1-4d17-b69c-c1bac1e68834 req-7aa236ae-8d52-4284-8412-512151a27d90 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 944 time: 0.4082785
May 31 16:21:24.512997 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-475d9ce4-aea1-4d17-b69c-c1bac1e68834 req-83fb23e5-37ea-42ab-8367-99f3ef055549 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0642591
May 31 16:21:24.543308 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-9541691b-d5d7-4772-819c-8a360ff3fb80 req-592dbc24-abf1-4186-ba3b-95441d90b4c7 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] For port 0e5a85ae-aafa-4bae-adee-5fc58eaad298, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=0e5a85ae-aafa-4bae-adee-5fc58eaad298,segment=NetworkSegment(5d13bef9-5e34-4b31-8817-4dba0534b3a7),segment_id=5d13bef9-5e34-4b31-8817-4dba0534b3a7)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:21:24.544198 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-9541691b-d5d7-4772-819c-8a360ff3fb80 req-592dbc24-abf1-4186-ba3b-95441d90b4c7 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:24.711411 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-134910460-network', 'tenant_id': '8e66b29e29094a429643e0308704753b'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:24.719368 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 5f8286e6-a0de-4023-a9eb-6eeb4f27b09f up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:24.736195 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:24.753473 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Usage tracker for resource:network and tenant:8e66b29e29094a429643e0308704753b is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:24.763869 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [req-9541691b-d5d7-4772-819c-8a360ff3fb80 req-592dbc24-abf1-4186-ba3b-95441d90b4c7 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Calling delete_port for 0e5a85ae-aafa-4bae-adee-5fc58eaad298 owned by compute:nova {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:21:24.764517 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:24.788023 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:24.829376 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Made reservation on behalf of 8e66b29e29094a429643e0308704753b for: {'network': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:21:24.832011 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-639279'] for network, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:24.867007 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:24.897751 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:24.913131 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Usage tracker for resource:security_group_rule and tenant:8e66b29e29094a429643e0308704753b is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:24.916982 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:24.946516 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port 5f8286e6-a0de-4023-a9eb-6eeb4f27b09f completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:21:24.953385 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 5f8286e6-a0de-4023-a9eb-6eeb4f27b09f triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:24.953807 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:24.975000 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:25.072541 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfaec2e0-df4e-4103-9006-db3c4e0a84ad req-61c80dcc-a731-474a-a544-5a77e0dd0463 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:25.081465 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bfaec2e0-df4e-4103-9006-db3c4e0a84ad req-61c80dcc-a731-474a-a544-5a77e0dd0463 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.1770203
May 31 16:21:25.218302 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bfaec2e0-df4e-4103-9006-db3c4e0a84ad req-337bf2be-f58e-4f67-bee8-8f69d8f23166 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1355836
May 31 16:21:25.253429 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:25.258204 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-9541691b-d5d7-4772-819c-8a360ff3fb80 req-592dbc24-abf1-4186-ba3b-95441d90b4c7 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:25.260745 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:25.270924 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-5766228f-9605-460f-b298-2becde0b3673 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:25.272124 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-6384438f-46f0-4ab5-b4ab-4932eaaf8aa2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:25.325809 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:25.364799 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port 5f8286e6-a0de-4023-a9eb-6eeb4f27b09f, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=5f8286e6-a0de-4023-a9eb-6eeb4f27b09f,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:21:25.372583 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:25.373381 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 808}  {{(pid=91763) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 31 16:21:25.376501 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-1e4c3c92-09b4-4cbc-aa87-bc0d0fc8f5ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:25.438698 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=36428dc9-0862-4d53-8a33-6b298f5353c7,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:25.476054 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:25.476261 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] Sync routers for ids ['bdad89a7-282d-4ae9-8124-6eabc155bcbe'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:21:25.480192 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.segments_db [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Added segment 44700c9f-b523-4212-86eb-cc7308ee0431 of type vlan for network e3df5118-0a40-4a66-b31c-a978a0c899cf
May 31 16:21:25.482556 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:25.535625 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] Routers {'bdad89a7-282d-4ae9-8124-6eabc155bcbe'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:21:25.536565 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f14262bf3a0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:21:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['bdad89a7-282d-4ae9-8124-6eabc155bcbe'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:25.537996 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732784079930'] for network, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:25.595821 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366'] for network, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:25.599637 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:25.601094 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:25.610629 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:25.613694 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-69585dd1-0ab0-41a9-8e8c-1484a0cec58a req-5b9325ba-6a53-4cdc-9124-0449b7df6ad5 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 210 time: 0.1815317
May 31 16:21:25.633420 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-592dbc24-abf1-4186-ba3b-95441d90b4c7 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Pushing event deleted for resources: {'Port': ['ID=0e5a85ae-aafa-4bae-adee-5fc58eaad298,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:25.638332 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-592dbc24-abf1-4186-ba3b-95441d90b4c7 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.366s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:25.757069 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:25.855490 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 1.5927515
May 31 16:21:25.862160 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59394) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:25.876430 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-93b7389d-0da4-4f57-b600-eacb8997162c admin admin] Request body: {'subnet': {'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-134910460-subnet', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'ip_version': 4}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:25.880829 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=5f8286e6-a0de-4023-a9eb-6eeb4f27b09f,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:25.887593 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.512s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:25.896631 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [req-9541691b-d5d7-4772-819c-8a360ff3fb80 req-592dbc24-abf1-4186-ba3b-95441d90b4c7 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] No DVR routers for this DVR port 0e5a85ae-aafa-4bae-adee-5fc58eaad298 on host hv-cinder-79381 {{(pid=91764) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:21:25.902205 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Pushing event updated for resources: {'Network': ['ID=e3df5118-0a40-4a66-b31c-a978a0c899cf,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:25.918474 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.307s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:25.922233 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-93b7389d-0da4-4f57-b600-eacb8997162c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:25.932975 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-93b7389d-0da4-4f57-b600-eacb8997162c admin admin] Usage tracker for resource:subnet and tenant:8e66b29e29094a429643e0308704753b is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:25.937228 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59400) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:25.940363 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-9541691b-d5d7-4772-819c-8a360ff3fb80 req-592dbc24-abf1-4186-ba3b-95441d90b4c7 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:25.945292 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1132cf94-cfb6-4b32-ae8b-ef0151475c72', 'name': 'network-vif-deleted', 'tag': '0e5a85ae-aafa-4bae-adee-5fc58eaad298'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:21:25.947031 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-bf12aac8-95ea-4ffc-b5dc-81272b3e87d6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1973905508', 'description': 'tempest-secgroup-smoke-1973905508 description', 'project_id': '092115f69b8e401b8c334f7b3e797aad'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:25.949402 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e3dc1c84-75c6-4d4a-977d-b2c92c913de9" -d '{"events": [{"server_uuid": "1132cf94-cfb6-4b32-ae8b-ef0151475c72", "name": "network-vif-deleted", "tag": "0e5a85ae-aafa-4bae-adee-5fc58eaad298"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:21:25.957332 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-bf12aac8-95ea-4ffc-b5dc-81272b3e87d6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:25.967012 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-bf12aac8-95ea-4ffc-b5dc-81272b3e87d6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Usage tracker for resource:security_group and tenant:092115f69b8e401b8c334f7b3e797aad is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:25.972368 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-bf12aac8-95ea-4ffc-b5dc-81272b3e87d6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:25.987326 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-bf12aac8-95ea-4ffc-b5dc-81272b3e87d6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:25.991233 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9541691b-d5d7-4772-819c-8a360ff3fb80 req-592dbc24-abf1-4186-ba3b-95441d90b4c7 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.63 "DELETE /v2.0/ports/0e5a85ae-aafa-4bae-adee-5fc58eaad298 HTTP/1.1" status: 204  len: 173 time: 2.2589946
May 31 16:21:26.013831 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-93b7389d-0da4-4f57-b600-eacb8997162c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:26.021506 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7655d2ff-7d7e-4519-a5b2-56d0e826e00b req-c8e6fff2-ed4f-4b89-a087-6ba7d2c7ed99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:26.026042 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7655d2ff-7d7e-4519-a5b2-56d0e826e00b req-c8e6fff2-ed4f-4b89-a087-6ba7d2c7ed99 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 1098 time: 0.2301233
May 31 16:21:26.027702 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-bf12aac8-95ea-4ffc-b5dc-81272b3e87d6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:26.034962 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Network e3df5118-0a40-4a66-b31c-a978a0c899cf details requested by agent ovs-agent-dv-cinder-793814-1-iscsi with host dv-cinder-793814-1-iscsi {{(pid=91765) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 31 16:21:26.066728 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-93b7389d-0da4-4f57-b600-eacb8997162c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:26.115224 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-bf12aac8-95ea-4ffc-b5dc-81272b3e87d6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:26.120580 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-93b7389d-0da4-4f57-b600-eacb8997162c admin admin] Made reservation on behalf of 8e66b29e29094a429643e0308704753b for: {'subnet': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:21:26.124706 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-93b7389d-0da4-4f57-b600-eacb8997162c admin admin] Notify callbacks [] for subnet, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:26.162708 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:21:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2f1cb9c3-d544-4ffa-b256-9e886934b1cb x-openstack-request-id: req-2f1cb9c3-d544-4ffa-b256-9e886934b1cb {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:21:26.165764 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1132cf94-cfb6-4b32-ae8b-ef0151475c72", "name": "network-vif-deleted", "tag": "0e5a85ae-aafa-4bae-adee-5fc58eaad298", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:21:26.166583 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-2f1cb9c3-d544-4ffa-b256-9e886934b1cb {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:21:26.167501 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1132cf94-cfb6-4b32-ae8b-ef0151475c72', 'name': 'network-vif-deleted', 'tag': '0e5a85ae-aafa-4bae-adee-5fc58eaad298', 'status': 'completed', 'code': 200}
May 31 16:21:26.199325 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7655d2ff-7d7e-4519-a5b2-56d0e826e00b req-63ac431c-c4d7-49ec-9264-c2ec23abd03f service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1584587
May 31 16:21:26.394779 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] Set router bdad89a7-282d-4ae9-8124-6eabc155bcbe gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:21:26.457745 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning for port a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:21:26.483905 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:26.484295 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:26.546179 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-bf12aac8-95ea-4ffc-b5dc-81272b3e87d6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Usage tracker for resource:security_group_rule and tenant:092115f69b8e401b8c334f7b3e797aad is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:26.552983 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-bf12aac8-95ea-4ffc-b5dc-81272b3e87d6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:26.573136 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-bf12aac8-95ea-4ffc-b5dc-81272b3e87d6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:26.594504 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09fd71e6-615d-473c-bc8a-6a3d47a44c5b req-2e616f08-31cf-4289-832f-c91a4939a10a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:26.601890 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-09fd71e6-615d-473c-bc8a-6a3d47a44c5b req-2e616f08-31cf-4289-832f-c91a4939a10a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 944 time: 0.3200653
May 31 16:21:26.807683 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 5f8286e6-a0de-4023-a9eb-6eeb4f27b09f up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:26.941056 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-09fd71e6-615d-473c-bc8a-6a3d47a44c5b req-83bb1ee1-b5fb-4890-88af-7533679b50c8 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3321216
May 31 16:21:27.053985 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-bf12aac8-95ea-4ffc-b5dc-81272b3e87d6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:27.060178 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a37ce5a-3044-4464-b7ff-bda5483a0d43 req-ae707c02-93c1-4bfd-9815-c15d1ac615f8 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:27.075850 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-bf12aac8-95ea-4ffc-b5dc-81272b3e87d6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:27.081699 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6a37ce5a-3044-4464-b7ff-bda5483a0d43 req-ae707c02-93c1-4bfd-9815-c15d1ac615f8 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.6543407
May 31 16:21:27.094624 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d9280c01-69ff-40fe-9931-3f6f91235f9f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:27.217700 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:27.269790 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6030e04e-d246-465d-8374-4d11b6a0ecb7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:21:27.274709 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d683e2b1-f38a-4d89-a6a9-e0bc010ad8de" -d '{"events": [{"server_uuid": "6030e04e-d246-465d-8374-4d11b6a0ecb7", "name": "network-vif-plugged", "status": "completed", "tag": "a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:21:27.294191 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 5f8286e6-a0de-4023-a9eb-6eeb4f27b09f triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:27.295447 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:27.305075 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-93b7389d-0da4-4f57-b600-eacb8997162c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357'] for subnet, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:27.339118 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-2dacfcb5-7472-491e-981c-020a6a1a1ec2 req-2919dc89-588a-4caf-9b9c-a5e825c69dfd tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Synchronizing usage tracker for tenant:16e81170a75c4b11a58e6d70b30c98b7 on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:21:27.369924 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6a37ce5a-3044-4464-b7ff-bda5483a0d43 req-bdb65284-1cfd-442c-a8fa-ade445a133dd tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2867143
May 31 16:21:27.385013 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9,segment=NetworkSegment(016e9daa-b906-4ec8-978d-cb58fbcd78da),segment_id=016e9daa-b906-4ec8-978d-cb58fbcd78da)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:21:27.394495 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:27.395726 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 0e5a85ae-aafa-4bae-adee-5fc58eaad298 no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:21:27.417972 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-2dacfcb5-7472-491e-981c-020a6a1a1ec2 req-2919dc89-588a-4caf-9b9c-a5e825c69dfd tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Unset dirty status for tenant:16e81170a75c4b11a58e6d70b30c98b7 on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:21:27.420165 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2dacfcb5-7472-491e-981c-020a6a1a1ec2 req-2919dc89-588a-4caf-9b9c-a5e825c69dfd tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] 10.222.0.43 "GET /v2.0/ports?device_id=1132cf94-cfb6-4b32-ae8b-ef0151475c72 HTTP/1.1" status: 200  len: 210 time: 0.2346230
May 31 16:21:27.430484 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf12aac8-95ea-4ffc-b5dc-81272b3e87d6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b16a6ce7-d949-48d8-8c08-03576b09b2e8,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:27.443637 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-bf12aac8-95ea-4ffc-b5dc-81272b3e87d6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.349s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:27.445891 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-2bc1a6f6-414f-4ad6-9741-57ef63456ce0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.032s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:27.479444 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-bf12aac8-95ea-4ffc-b5dc-81272b3e87d6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:27.485168 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-bf12aac8-95ea-4ffc-b5dc-81272b3e87d6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 1.5417747
May 31 16:21:27.486542 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 59426) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:27.497505 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-c400822a-5666-4056-b655-2b1b3600f981 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Request body: {'security_group_rule': {'security_group_id': 'b16a6ce7-d949-48d8-8c08-03576b09b2e8', 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:27.524257 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-c400822a-5666-4056-b655-2b1b3600f981 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:27.538383 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-c400822a-5666-4056-b655-2b1b3600f981 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Usage tracker for resource:security_group_rule and tenant:092115f69b8e401b8c334f7b3e797aad is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:27.549964 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:27.551317 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-c400822a-5666-4056-b655-2b1b3600f981 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:27.576274 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93b7389d-0da4-4f57-b600-eacb8997162c admin admin] Checking segment: {'id': '44700c9f-b523-4212-86eb-cc7308ee0431', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 808, 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91763) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:27.576644 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93b7389d-0da4-4f57-b600-eacb8997162c admin admin] Network hostable DHCP agents. Network: e3df5118-0a40-4a66-b31c-a978a0c899cf, hostable agents: ['5c9859e8-5965-4c86-8b2b-8fab235cbf66'], hosted agents: [] {{(pid=91763) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 31 16:21:27.577893 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-c400822a-5666-4056-b655-2b1b3600f981 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:27.591790 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93b7389d-0da4-4f57-b600-eacb8997162c admin admin] Pushing event updated for resources: {'Subnet': ['ID=1a675b0f-478f-47e0-acdd-51bacffe39b6,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:27.600859 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-93b7389d-0da4-4f57-b600-eacb8997162c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:27.614135 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93b7389d-0da4-4f57-b600-eacb8997162c admin admin] Network e3df5118-0a40-4a66-b31c-a978a0c899cf is scheduled to be hosted by DHCP agent 5c9859e8-5965-4c86-8b2b-8fab235cbf66 with binding_index 1 {{(pid=91763) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 31 16:21:27.628291 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-93b7389d-0da4-4f57-b600-eacb8997162c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793814-1-iscsi, e3df5118-0a40-4a66-b31c-a978a0c899cf) {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:27.636995 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93b7389d-0da4-4f57-b600-eacb8997162c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:27.637777 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-93b7389d-0da4-4f57-b600-eacb8997162c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:27.639743 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c400822a-5666-4056-b655-2b1b3600f981 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:27.673122 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:21:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c68317ba-bdda-4a6b-8f22-956963cefa12 x-openstack-request-id: req-c68317ba-bdda-4a6b-8f22-956963cefa12 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:21:27.673545 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6030e04e-d246-465d-8374-4d11b6a0ecb7", "name": "network-vif-plugged", "status": "completed", "tag": "a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:21:27.673876 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-c68317ba-bdda-4a6b-8f22-956963cefa12 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:21:27.674271 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6030e04e-d246-465d-8374-4d11b6a0ecb7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9', 'code': 200}
May 31 16:21:27.683625 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-93b7389d-0da4-4f57-b600-eacb8997162c admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 850 time: 1.8195593
May 31 16:21:27.686206 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 59432) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:27.689342 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] No Port match for: 0e5a85ae-aafa-4bae-adee-5fc58eaad298 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:21:27.689733 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 0e5a85ae-aafa-4bae-adee-5fc58eaad298 not bound to the agent host hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:21:27.694015 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c003218-e629-4f5e-8140-1aba11c1e5be None None] Network e3df5118-0a40-4a66-b31c-a978a0c899cf requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:21:27.713574 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-134910460-router', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:27.739177 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:27.759521 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Usage tracker for resource:router and tenant:8e66b29e29094a429643e0308704753b is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:27.776463 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:27.790983 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:27.820027 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c400822a-5666-4056-b655-2b1b3600f981 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:27.825077 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-16623804', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-697'] for router, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:27.826273 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-16618684', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-16621667', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-16430734', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-672'] for router, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:27.831265 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c400822a-5666-4056-b655-2b1b3600f981 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:27.839632 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f14262bf3a0>, [{'id': 'bdad89a7-282d-4ae9-8124-6eabc155bcbe', 'name': 'tempest-TestVolumeBootPattern-9966473-router', 'tenant_id': 'd632158d834f4af7851eaec17fb0b06f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.177'}], 'enable_snat': True}, 'gw_port_id': '5f8286e6-a0de-4023-a9eb-6eeb4f27b09f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:14Z', 'updated_at': '2021-05-31T16:21:22Z', 'revision_number': 4, 'project_id': 'd632158d834f4af7851eaec17fb0b06f', 'gw_port': {'id': '5f8286e6-a0de-4023-a9eb-6eeb4f27b09f', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:f0:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bdad89a7-282d-4ae9-8124-6eabc155bcbe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 281, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:16Z', 'updated_at': '2021-05-31T16:21:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '321d16c6-0236-4519-8174-ad604590b1fc', 'name': '', 'network_id': '1148d900-6e78-4b1c-b565-d533f8532051', 'tenant_id': 'd632158d834f4af7851eaec17fb0b06f', 'mac_address': 'fa:16:3e:bd:8b:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bdad89a7-282d-4ae9-8124-6eabc155bcbe', 'device_owner': 'network:router_interface', 'standard_attr_id': 287, 'fixed_ips': [{'subnet_id': 'fbc4ea0f-be4f-4d1c-a5f9-9c05726a34ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:20Z', 'updated_at': '2021-05-31T16:21:22Z', 'revision_number': 2, 'project_id': 'd632158d834f4af7851eaec17fb0b06f', 'subnets': [{'id': 'fbc4ea0f-be4f-4d1c-a5f9-9c05726a34ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:27.878592 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:27.886659 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] Checking router: bdad89a7-282d-4ae9-8124-6eabc155bcbe for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:21:27.887034 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] Updating router bdad89a7-282d-4ae9-8124-6eabc155bcbe port 321d16c6-0236-4519-8174-ad604590b1fc binding host dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 31 16:21:27.920231 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c400822a-5666-4056-b655-2b1b3600f981 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=67e8c2c8-0348-4253-af54-36939b680a71,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:27.926523 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:27.933771 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c400822a-5666-4056-b655-2b1b3600f981 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:27.945402 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c400822a-5666-4056-b655-2b1b3600f981 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:27.949568 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-c400822a-5666-4056-b655-2b1b3600f981 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.4612589
May 31 16:21:27.949753 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:27.950084 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59438) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:27.968094 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.418s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:27.988444 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-214e2809-29b3-42b9-a354-b00884072aca tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Request body: {'security_group_rule': {'security_group_id': 'b16a6ce7-d949-48d8-8c08-03576b09b2e8', 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:28.002761 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:28.011549 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-214e2809-29b3-42b9-a354-b00884072aca tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:28.029836 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-214e2809-29b3-42b9-a354-b00884072aca tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Usage tracker for resource:security_group_rule and tenant:092115f69b8e401b8c334f7b3e797aad is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:28.032488 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-112a0b9b-593b-429d-b027-bab48a6a80db req-cd4f09d5-4262-4b02-8d2d-65d17aa3fa12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:28.034006 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-112a0b9b-593b-429d-b027-bab48a6a80db req-cd4f09d5-4262-4b02-8d2d-65d17aa3fa12 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 1098 time: 0.2038107
May 31 16:21:28.035472 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-214e2809-29b3-42b9-a354-b00884072aca tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:28.046393 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-214e2809-29b3-42b9-a354-b00884072aca tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:28.084033 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-214e2809-29b3-42b9-a354-b00884072aca tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:28.185980 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-214e2809-29b3-42b9-a354-b00884072aca tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:28.192764 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-214e2809-29b3-42b9-a354-b00884072aca tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:28.195356 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:28.235617 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-214e2809-29b3-42b9-a354-b00884072aca tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:28.237465 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-214e2809-29b3-42b9-a354-b00884072aca tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.2859433
May 31 16:21:28.238520 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-214e2809-29b3-42b9-a354-b00884072aca tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5c4b3ae9-1484-4922-a88b-e8a3dabd043c,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:28.243572 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59450) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:28.246632 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-214e2809-29b3-42b9-a354-b00884072aca tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:28.250763 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-3368244c-ce70-4e0f-91fe-935fd7834f64 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Request body: {'security_group_rule': {'security_group_id': 'b16a6ce7-d949-48d8-8c08-03576b09b2e8', 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:28.258283 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-3368244c-ce70-4e0f-91fe-935fd7834f64 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:28.263700 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-3368244c-ce70-4e0f-91fe-935fd7834f64 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Usage tracker for resource:security_group_rule and tenant:092115f69b8e401b8c334f7b3e797aad is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:28.267351 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-3368244c-ce70-4e0f-91fe-935fd7834f64 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:28.276559 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-3368244c-ce70-4e0f-91fe-935fd7834f64 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:28.300148 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3368244c-ce70-4e0f-91fe-935fd7834f64 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:28.327589 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp87ca72be-1027-56d4-a8d3-ba9dae998815-e3df5118-0a40-4a66-b31c-a978a0c899cf', 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'fixed_ips': [{'subnet_id': '1a675b0f-478f-47e0-acdd-51bacffe39b6'}]}} from dv-cinder-793814-1-iscsi. {{(pid=91765) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 31 16:21:28.328862 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:28.346669 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-112a0b9b-593b-429d-b027-bab48a6a80db req-0eca83c8-64ce-4fad-ad10-5f39d7ef55cb service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3033378
May 31 16:21:28.391037 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3368244c-ce70-4e0f-91fe-935fd7834f64 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:28.397403 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3368244c-ce70-4e0f-91fe-935fd7834f64 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:28.400191 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:28.430244 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16621638', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16623758', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-722'] for router, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:28.452021 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3368244c-ce70-4e0f-91fe-935fd7834f64 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ce7afbe5-b5d0-4b55-8792-bd0ac848241e,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:28.464866 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-3368244c-ce70-4e0f-91fe-935fd7834f64 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:28.483328 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bbfcc72-9ec7-48a0-a6ed-b6bb609a8765 req-3fbe0bee-d7f9-4654-9b63-e9481c614fe9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:28.485005 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3368244c-ce70-4e0f-91fe-935fd7834f64 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:28.487818 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-3368244c-ce70-4e0f-91fe-935fd7834f64 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.2418087
May 31 16:21:28.491268 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59458) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:28.494524 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5bbfcc72-9ec7-48a0-a6ed-b6bb609a8765 req-3fbe0bee-d7f9-4654-9b63-e9481c614fe9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 945 time: 0.3125119
May 31 16:21:28.506902 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-d4ffb810-acbe-4810-8b00-949049912504 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Request body: {'security_group_rule': {'security_group_id': 'b16a6ce7-d949-48d8-8c08-03576b09b2e8', 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:28.518258 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-d4ffb810-acbe-4810-8b00-949049912504 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:28.526382 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-d4ffb810-acbe-4810-8b00-949049912504 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Usage tracker for resource:security_group_rule and tenant:092115f69b8e401b8c334f7b3e797aad is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:28.530727 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-d4ffb810-acbe-4810-8b00-949049912504 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:28.537621 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-d4ffb810-acbe-4810-8b00-949049912504 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:28.557805 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d4ffb810-acbe-4810-8b00-949049912504 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:28.630688 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5bbfcc72-9ec7-48a0-a6ed-b6bb609a8765 req-2ce798c2-75a8-4e39-b138-80807aa8479e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1353619
May 31 16:21:28.637437 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d4ffb810-acbe-4810-8b00-949049912504 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:28.643198 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d4ffb810-acbe-4810-8b00-949049912504 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:28.657716 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-3368244c-ce70-4e0f-91fe-935fd7834f64 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:28.691086 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4ffb810-acbe-4810-8b00-949049912504 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=80f1fe60-9b7e-498f-98df-7c5af52404bb,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:28.695591 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.db_base_plugin_common [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Allocated IP 172.20.0.2 (e3df5118-0a40-4a66-b31c-a978a0c899cf/1a675b0f-478f-47e0-acdd-51bacffe39b6/fce86ab6-1557-4a78-936b-fe27e15e00ac) {{(pid=91765) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:21:28.697553 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d4ffb810-acbe-4810-8b00-949049912504 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:28.702706 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d4ffb810-acbe-4810-8b00-949049912504 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:28.703038 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85189373-5110-4132-8a4d-b27788c532ba req-f6a6c059-9a80-4c43-a63a-e10762d52280 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:28.704879 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-85189373-5110-4132-8a4d-b27788c532ba req-f6a6c059-9a80-4c43-a63a-e10762d52280 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.1336346
May 31 16:21:28.708747 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-d4ffb810-acbe-4810-8b00-949049912504 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.2099330
May 31 16:21:28.709419 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59462) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:28.717468 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-925090f9-44f6-40f6-badc-0d902e031679 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Request body: {'security_group_rule': {'security_group_id': 'b16a6ce7-d949-48d8-8c08-03576b09b2e8', 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:28.726278 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-925090f9-44f6-40f6-badc-0d902e031679 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:28.731107 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-925090f9-44f6-40f6-badc-0d902e031679 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Usage tracker for resource:security_group_rule and tenant:092115f69b8e401b8c334f7b3e797aad is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:28.734713 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-925090f9-44f6-40f6-badc-0d902e031679 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:28.742785 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-925090f9-44f6-40f6-badc-0d902e031679 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:28.760005 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.securitygroups_db [None req-925090f9-44f6-40f6-badc-0d902e031679 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Project 092115f69b8e401b8c334f7b3e797aad added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 31 16:21:28.769681 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-925090f9-44f6-40f6-badc-0d902e031679 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:28.779396 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-85189373-5110-4132-8a4d-b27788c532ba req-0e5c9a61-2dae-4ba6-abdb-48678345ab6d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0664093
May 31 16:21:28.838519 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.db.resource_extend [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
May 31 16:21:28.920087 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-925090f9-44f6-40f6-badc-0d902e031679 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:28.924811 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-925090f9-44f6-40f6-badc-0d902e031679 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:28.943211 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:28.970690 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-925090f9-44f6-40f6-badc-0d902e031679 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9529378c-2d76-4379-ace8-dbc2f042909d,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:28.992360 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-925090f9-44f6-40f6-badc-0d902e031679 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:29.001323 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] Notify callbacks [] for port, precommit_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:29.013374 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-925090f9-44f6-40f6-badc-0d902e031679 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:29.015565 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-925090f9-44f6-40f6-badc-0d902e031679 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.3049798
May 31 16:21:29.019044 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59478) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:29.033566 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-de9fa733-c5c1-45da-87a9-46c2a61b084c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Request body: {'security_group_rule': {'security_group_id': 'b16a6ce7-d949-48d8-8c08-03576b09b2e8', 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:29.046630 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] Transition to ACTIVE for port object 321d16c6-0236-4519-8174-ad604590b1fc will not be triggered until provisioned by entity L2. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:29.048328 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-de9fa733-c5c1-45da-87a9-46c2a61b084c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:29.061826 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-de9fa733-c5c1-45da-87a9-46c2a61b084c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Usage tracker for resource:security_group_rule and tenant:092115f69b8e401b8c334f7b3e797aad is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:29.071946 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-de9fa733-c5c1-45da-87a9-46c2a61b084c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:29.086736 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-de9fa733-c5c1-45da-87a9-46c2a61b084c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:29.099835 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.securitygroups_db [None req-de9fa733-c5c1-45da-87a9-46c2a61b084c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Project 092115f69b8e401b8c334f7b3e797aad added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 31 16:21:29.103097 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:29.108192 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-de9fa733-c5c1-45da-87a9-46c2a61b084c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:29.110517 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:29.166388 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:29.241382 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:29.245136 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-de9fa733-c5c1-45da-87a9-46c2a61b084c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:29.254959 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-de9fa733-c5c1-45da-87a9-46c2a61b084c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:29.256953 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:29.290221 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2276730f-71b6-41f9-8b61-f799e5de6a6a None None] Pushing event updated for resources: {'Port': ['ID=321d16c6-0236-4519-8174-ad604590b1fc,revision_number=3']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:29.303965 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2276730f-71b6-41f9-8b61-f799e5de6a6a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:29.306989 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de9fa733-c5c1-45da-87a9-46c2a61b084c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=31b9822c-17ae-47f3-869a-cfe5f3e76296,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:29.307621 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Notify callbacks [] for port, precommit_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:29.310437 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-de9fa733-c5c1-45da-87a9-46c2a61b084c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:29.327327 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-de9fa733-c5c1-45da-87a9-46c2a61b084c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:29.340821 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-de9fa733-c5c1-45da-87a9-46c2a61b084c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.3109338
May 31 16:21:29.405421 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff4d4819-4302-45ad-a4aa-f8f8c214de13 req-1f8c3831-c15b-4544-9271-ccd18922238b tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:29.413021 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ff4d4819-4302-45ad-a4aa-f8f8c214de13 req-1f8c3831-c15b-4544-9271-ccd18922238b tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.3859146
May 31 16:21:29.506710 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Transition to ACTIVE for port object fce86ab6-1557-4a78-936b-fe27e15e00ac will not be triggered until provisioned by entity L2. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:29.527269 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ff4d4819-4302-45ad-a4aa-f8f8c214de13 req-aa531d34-c9f3-44f8-acde-69092a7a6291 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1044021
May 31 16:21:29.574441 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Allocated IP 172.27.0.182 (00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c/96709d85-d0fe-4cf8-b232-eaf6b143ebe6/a225a2ee-fc85-4ac1-9115-01b63bb0296a) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:21:29.591425 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Transition to ACTIVE for port object fce86ab6-1557-4a78-936b-fe27e15e00ac will not be triggered until provisioned by entity DHCP. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:29.594893 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] Attempting to bind port 321d16c6-0236-4519-8174-ad604590b1fc on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:21:29.595201 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] Attempting to bind port 321d16c6-0236-4519-8174-ad604590b1fc by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 826, 'network_id': '1148d900-6e78-4b1c-b565-d533f8532051'}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:21:29.595587 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] Attempting to bind port 321d16c6-0236-4519-8174-ad604590b1fc on network 1148d900-6e78-4b1c-b565-d533f8532051 {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:21:29.610309 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 21, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:21:29.611023 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] Checking segment: {'id': '82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 826, 'network_id': '1148d900-6e78-4b1c-b565-d533f8532051'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91765) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:29.611532 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:29.611969 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] Bound using segment: {'id': '82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 826, 'network_id': '1148d900-6e78-4b1c-b565-d533f8532051'} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:21:29.612793 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] Bound port: 321d16c6-0236-4519-8174-ad604590b1fc, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 826, 'network_id': '1148d900-6e78-4b1c-b565-d533f8532051'}}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:21:29.613129 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:29.713833 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:29.734536 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:29.841367 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:29.904035 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:29.910185 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-acb14e41-b74e-4c1b-a258-1ba6111611f6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:29.925329 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Network e3df5118-0a40-4a66-b31c-a978a0c899cf is already hosted by enough agents. {{(pid=91765) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:21:29.971562 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59534) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:29.979145 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] For port 321d16c6-0236-4519-8174-ad604590b1fc, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91765) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:21:29.982836 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] For port 321d16c6-0236-4519-8174-ad604590b1fc, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=321d16c6-0236-4519-8174-ad604590b1fc,segment=NetworkSegment(82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996),segment_id=82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996)] {{(pid=91765) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:21:29.985792 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.scheduler.base_scheduler [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Resources bound (agent type, host, resource id):  {{(pid=91765) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:29.996732 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Received port after_create {{(pid=91765) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:21:30.000518 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:30.072887 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Pushing event updated for resources: {'Port': ['ID=fce86ab6-1557-4a78-936b-fe27e15e00ac,revision_number=1']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:30.151111 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.417s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:30.168177 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-508dc191-cbd6-41e8-9cc5-005e09112aa2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.155s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:30.233626 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:21:30.241887 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:30.254535 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:21:30.266919 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d4fcd463-a7b4-4a52-bab9-a428bbccb2a8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:30.267607 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] Routers {'bdad89a7-282d-4ae9-8124-6eabc155bcbe'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:21:30.267923 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f14262bf3a0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:21:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['bdad89a7-282d-4ae9-8124-6eabc155bcbe'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:30.287022 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-d4fcd463-a7b4-4a52-bab9-a428bbccb2a8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:30.292343 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-d4fcd463-a7b4-4a52-bab9-a428bbccb2a8 admin admin] Usage tracker for resource:security_group_rule and tenant:7c28b21f43cc446e9d21c4304485bbdb is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:30.296335 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-d4fcd463-a7b4-4a52-bab9-a428bbccb2a8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:30.304055 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-d4fcd463-a7b4-4a52-bab9-a428bbccb2a8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:30.378897 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Attempting to bind port fce86ab6-1557-4a78-936b-fe27e15e00ac on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:21:30.379273 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Attempting to bind port fce86ab6-1557-4a78-936b-fe27e15e00ac by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '44700c9f-b523-4212-86eb-cc7308ee0431', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 808, 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf'}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:21:30.380167 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Attempting to bind port fce86ab6-1557-4a78-936b-fe27e15e00ac on network e3df5118-0a40-4a66-b31c-a978a0c899cf {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:21:30.404276 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 21, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:21:30.404664 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Checking segment: {'id': '44700c9f-b523-4212-86eb-cc7308ee0431', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 808, 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91765) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:30.405102 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:30.405502 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Bound using segment: {'id': '44700c9f-b523-4212-86eb-cc7308ee0431', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 808, 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf'} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:21:30.409983 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Bound port: fce86ab6-1557-4a78-936b-fe27e15e00ac, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44700c9f-b523-4212-86eb-cc7308ee0431', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 808, 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf'}}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:21:30.410521 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:30.508095 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d4fcd463-a7b4-4a52-bab9-a428bbccb2a8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:30.514919 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Pushing event updated for resources: {'Port': ['ID=a225a2ee-fc85-4ac1-9115-01b63bb0296a,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:30.518633 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d4fcd463-a7b4-4a52-bab9-a428bbccb2a8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:30.546452 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-811c779b-73ba-4785-afb0-21c531233709 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:30.550556 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.640s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:30.752297 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c71c461-3bba-460b-81be-d80cb6d9d9c7 req-ca45c913-fdee-4334-9884-da500620d3c9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:30.754290 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4fcd463-a7b4-4a52-bab9-a428bbccb2a8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2740fc40-0245-4b53-a3f8-86d446fb6104,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:30.761374 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d4fcd463-a7b4-4a52-bab9-a428bbccb2a8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.229s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:30.763431 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4c71c461-3bba-460b-81be-d80cb6d9d9c7 req-ca45c913-fdee-4334-9884-da500620d3c9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 945 time: 0.7788117
May 31 16:21:30.769261 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 59562) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:30.771680 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-d4fcd463-a7b4-4a52-bab9-a428bbccb2a8 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=7c28b21f43cc446e9d21c4304485bbdb&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7931259
May 31 16:21:30.774555 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2276730f-71b6-41f9-8b61-f799e5de6a6a None None] Pushing event updated for resources: {'Port': ['ID=321d16c6-0236-4519-8174-ad604590b1fc,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:30.917242 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] Set router bdad89a7-282d-4ae9-8124-6eabc155bcbe gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:21:31.018664 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59572) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:31.176190 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4c71c461-3bba-460b-81be-d80cb6d9d9c7 req-e9fd91df-550a-4179-bfb7-11dd7b193b3d tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4114726
May 31 16:21:31.193862 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_v2 [None req-6c37853a-297f-472c-9cd3-27b07616a985 admin admin] Deleting subnet d6d29986-6b64-4e75-9065-dbd87b0b7ea3 {{(pid=91763) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 31 16:21:31.197590 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6c37853a-297f-472c-9cd3-27b07616a985 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:31.254996 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] For port fce86ab6-1557-4a78-936b-fe27e15e00ac, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91765) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:21:31.262484 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] For port fce86ab6-1557-4a78-936b-fe27e15e00ac, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=fce86ab6-1557-4a78-936b-fe27e15e00ac,segment=NetworkSegment(44700c9f-b523-4212-86eb-cc7308ee0431),segment_id=44700c9f-b523-4212-86eb-cc7308ee0431)] {{(pid=91765) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:21:31.272208 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2276730f-71b6-41f9-8b61-f799e5de6a6a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.104s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:31.288214 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:31.298795 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:31.326024 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:31.337057 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6c37853a-297f-472c-9cd3-27b07616a985 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:31.352846 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6c37853a-297f-472c-9cd3-27b07616a985 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-975336'] for subnet, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:31.495492 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-258a2702-f15f-43a4-b5aa-9e43a024425c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:31.534055 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Pushing event updated for resources: {'Port': ['ID=fce86ab6-1557-4a78-936b-fe27e15e00ac,revision_number=2']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:31.564916 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.266s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:31.693102 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-258a2702-f15f-43a4-b5aa-9e43a024425c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:31.794329 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f14262bf3a0>, [{'id': 'bdad89a7-282d-4ae9-8124-6eabc155bcbe', 'name': 'tempest-TestVolumeBootPattern-9966473-router', 'tenant_id': 'd632158d834f4af7851eaec17fb0b06f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.177'}], 'enable_snat': True}, 'gw_port_id': '5f8286e6-a0de-4023-a9eb-6eeb4f27b09f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:14Z', 'updated_at': '2021-05-31T16:21:22Z', 'revision_number': 4, 'project_id': 'd632158d834f4af7851eaec17fb0b06f', 'gw_port': {'id': '5f8286e6-a0de-4023-a9eb-6eeb4f27b09f', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:f0:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bdad89a7-282d-4ae9-8124-6eabc155bcbe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 281, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:16Z', 'updated_at': '2021-05-31T16:21:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '321d16c6-0236-4519-8174-ad604590b1fc', 'name': '', 'network_id': '1148d900-6e78-4b1c-b565-d533f8532051', 'tenant_id': 'd632158d834f4af7851eaec17fb0b06f', 'mac_address': 'fa:16:3e:bd:8b:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bdad89a7-282d-4ae9-8124-6eabc155bcbe', 'device_owner': 'network:router_interface', 'standard_attr_id': 287, 'fixed_ips': [{'subnet_id': 'fbc4ea0f-be4f-4d1c-a5f9-9c05726a34ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:20Z', 'updated_at': '2021-05-31T16:21:29Z', 'revision_number': 4, 'project_id': 'd632158d834f4af7851eaec17fb0b06f', 'subnets': [{'id': 'fbc4ea0f-be4f-4d1c-a5f9-9c05726a34ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:31.808105 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3767ef55-c3e4-4c15-b57d-15cf50cd1766 None None] The sync data for ids ['bdad89a7-282d-4ae9-8124-6eabc155bcbe'] in dv-cinder-793814-1-iscsi is: [{'id': 'bdad89a7-282d-4ae9-8124-6eabc155bcbe', 'name': 'tempest-TestVolumeBootPattern-9966473-router', 'tenant_id': 'd632158d834f4af7851eaec17fb0b06f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.177'}], 'enable_snat': True}, 'gw_port_id': '5f8286e6-a0de-4023-a9eb-6eeb4f27b09f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:14Z', 'updated_at': '2021-05-31T16:21:22Z', 'revision_number': 4, 'project_id': 'd632158d834f4af7851eaec17fb0b06f', 'gw_port': {'id': '5f8286e6-a0de-4023-a9eb-6eeb4f27b09f', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:f0:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bdad89a7-282d-4ae9-8124-6eabc155bcbe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 281, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:16Z', 'updated_at': '2021-05-31T16:21:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '321d16c6-0236-4519-8174-ad604590b1fc', 'name': '', 'network_id': '1148d900-6e78-4b1c-b565-d533f8532051', 'tenant_id': 'd632158d834f4af7851eaec17fb0b06f', 'mac_address': 'fa:16:3e:bd:8b:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bdad89a7-282d-4ae9-8124-6eabc155bcbe', 'device_owner': 'network:router_interface', 'standard_attr_id': 287, 'fixed_ips': [{'subnet_id': 'fbc4ea0f-be4f-4d1c-a5f9-9c05726a34ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:20Z', 'updated_at': '2021-05-31T16:21:29Z', 'revision_number': 4, 'project_id': 'd632158d834f4af7851eaec17fb0b06f', 'subnets': [{'id': 'fbc4ea0f-be4f-4d1c-a5f9-9c05726a34ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:21:31.846060 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6c37853a-297f-472c-9cd3-27b07616a985 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-978269', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357'] for subnet, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:31.873711 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-93b7389d-0da4-4f57-b600-eacb8997162c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:31.959060 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6c37853a-297f-472c-9cd3-27b07616a985 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:31.974229 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c37853a-297f-472c-9cd3-27b07616a985 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d6d29986-6b64-4e75-9065-dbd87b0b7ea3,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:31.974229 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-6c37853a-297f-472c-9cd3-27b07616a985 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:32.009275 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-6c37853a-297f-472c-9cd3-27b07616a985 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/d6d29986-6b64-4e75-9065-dbd87b0b7ea3 HTTP/1.1" status: 204  len: 168 time: 0.9872475
May 31 16:21:32.011661 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59610) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:32.059381 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-258a2702-f15f-43a4-b5aa-9e43a024425c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:32.078984 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-eaf1f7d4-ccba-40c7-8b04-540574b7d406 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:32.165326 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-258a2702-f15f-43a4-b5aa-9e43a024425c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2740fc40-0245-4b53-a3f8-86d446fb6104,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:32.172134 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-258a2702-f15f-43a4-b5aa-9e43a024425c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:32.265470 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-525980'] for network, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:32.464236 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-258a2702-f15f-43a4-b5aa-9e43a024425c admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:32.471218 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-258a2702-f15f-43a4-b5aa-9e43a024425c admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/2740fc40-0245-4b53-a3f8-86d446fb6104 HTTP/1.1" status: 204  len: 168 time: 1.6710989
May 31 16:21:32.497384 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-16623797', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16621573'] for router, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:32.566807 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-988775', 'neutron.services.segments.db._delete_segments_for_network-8732784586204'] for network, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:32.614846 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7f1426488310>> segment before_delete 55550000 {{(pid=91763) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:32.616031 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7f1426488310>> subnet precommit_delete_associations 55550000 {{(pid=91763) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:32.618141 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f1425831250>> segment_host_mapping after_create 55550000 {{(pid=91763) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:32.618735 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f1425831250>> port after_create 55550000 {{(pid=91763) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:32.620275 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f1425831250>> port after_delete 55550000 {{(pid=91763) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:32.620844 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f1425831250>> port after_update 55550000 {{(pid=91763) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:32.621968 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f1425831250>> segment after_delete 55550000 {{(pid=91763) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:32.622747 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f1425831250>> subnet after_create 55550000 {{(pid=91763) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:32.624069 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f1425831250>> subnet after_delete 55550000 {{(pid=91763) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:32.625642 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f1425831250>> subnet after_update 55550000 {{(pid=91763) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:32.900380 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device fce86ab6-1557-4a78-936b-fe27e15e00ac up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:32.979771 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f14257775e0>> subnet after_create 55550000 {{(pid=91763) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:32.980763 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f14257775e0>> subnet after_delete 55550000 {{(pid=91763) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:32.981416 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f14257775e0>> subnet before_create 55550000 {{(pid=91763) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:32.981973 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f14257775e0>> subnet before_update 55550000 {{(pid=91763) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:32.982548 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f1426488550>,) {'filters': {'network_id': ['c99513ad-3df3-429c-a5ba-a2334e5c92fc']}} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:33.014071 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f1426488550>, '5d13bef9-5e34-4b31-8817-4dba0534b3a7') {'for_net_delete': True} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:33.018052 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f1426488550>, '5d13bef9-5e34-4b31-8817-4dba0534b3a7') {} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:33.064320 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732784599197', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15104868'] for segment, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:33.115359 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:33.141804 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Releasing vlan 815 on physical network physnet1 to pool {{(pid=91763) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 31 16:21:33.142829 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14337126'] for segment, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:33.186272 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port fce86ab6-1557-4a78-936b-fe27e15e00ac completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:21:33.203028 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 321d16c6-0236-4519-8174-ad604590b1fc up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:   from cryptography.utils import int_from_bytes
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:   from cryptography.utils import int_from_bytes
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]: Traceback (most recent call last):
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:     timer()
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:     cb(*args, **kw)
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:     return func(*args, **kwargs)
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:     self._notify()
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:     self.callback(batched_events)
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:     event.method(event)
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:     aggregate_uuid = self.p_client.list_aggregates(
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:     return f(self, *a, **k)
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self._get(url).json()
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self.request(url, 'GET', **kwargs)
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:     base_url = self.get_endpoint(auth, allow=allow,
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 31 16:21:33.386717 dv-cinder-793814-1-iscsi neutron-server[91763]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 31 16:21:33.389376 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59636) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:33.425386 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16621775'] for network, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:33.450171 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port 321d16c6-0236-4519-8174-ad604590b1fc completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:21:33.467680 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:33.475678 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 321d16c6-0236-4519-8174-ad604590b1fc triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:33.484059 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:33.484864 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-052f7a5b-78b4-4ccc-a626-ab0b40958bfb admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:33.501162 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:33.514698 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-052f7a5b-78b4-4ccc-a626-ab0b40958bfb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:33.555833 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-052f7a5b-78b4-4ccc-a626-ab0b40958bfb admin admin] Usage tracker for resource:security_group_rule and tenant:d12460eabe9c4633a6f9b745052cc5d9 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:33.571309 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Router 7928d30e-0100-4eb5-9431-cf404997bd15 is scheduled to L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e with binding_index 1 {{(pid=91764) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 31 16:21:33.590787 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] 10.222.0.43 "DELETE /v2.0/networks/c99513ad-3df3-429c-a5ba-a2334e5c92fc HTTP/1.1" status: 204  len: 168 time: 1.5690303
May 31 16:21:33.591804 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Pushing event deleted for resources: {'Network': ['ID=c99513ad-3df3-429c-a5ba-a2334e5c92fc,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:33.601802 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:33.602051 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd7c1d1-2a94-4ee3-9776-58b30a60f5ca req-4085d97f-8e23-43af-bf8b-f8da52742203 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:33.604398 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-052f7a5b-78b4-4ccc-a626-ab0b40958bfb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:33.612514 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4bd7c1d1-2a94-4ee3-9776-58b30a60f5ca req-4085d97f-8e23-43af-bf8b-f8da52742203 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=1739d3c0e2734c8a9af5c5291aac8e25&device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 1099 time: 0.3819823
May 31 16:21:33.627245 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db650fd8-a48b-4a03-bfe1-6ec83515830b req-3bb4081d-c32d-4b0e-a41f-48bd0c4b4a73 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:33.629353 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-db650fd8-a48b-4a03-bfe1-6ec83515830b req-3bb4081d-c32d-4b0e-a41f-48bd0c4b4a73 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.2597697
May 31 16:21:33.633342 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-052f7a5b-78b4-4ccc-a626-ab0b40958bfb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:33.681736 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4404db46-fab7-434f-b1c3-783a93294192 None None] Network e3df5118-0a40-4a66-b31c-a978a0c899cf requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:21:33.849890 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-052f7a5b-78b4-4ccc-a626-ab0b40958bfb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:33.863311 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-052f7a5b-78b4-4ccc-a626-ab0b40958bfb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:33.892654 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:33.904682 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:33.932629 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-cb894f4f-133f-4856-8327-c4a8ba3c931f None None] Provisioning for port fce86ab6-1557-4a78-936b-fe27e15e00ac completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:21:33.949040 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-db650fd8-a48b-4a03-bfe1-6ec83515830b req-79f262fe-1554-41cf-9c7b-5674852b7153 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2897136
May 31 16:21:33.950217 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-052f7a5b-78b4-4ccc-a626-ab0b40958bfb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=389798bc-55cf-4867-9603-fa79da525211,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:33.956399 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-052f7a5b-78b4-4ccc-a626-ab0b40958bfb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:33.980454 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-cb894f4f-133f-4856-8327-c4a8ba3c931f None None] Provisioning complete for port fce86ab6-1557-4a78-936b-fe27e15e00ac triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:33.985709 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-cb894f4f-133f-4856-8327-c4a8ba3c931f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:34.022633 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-052f7a5b-78b4-4ccc-a626-ab0b40958bfb admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=d12460eabe9c4633a6f9b745052cc5d9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6310558
May 31 16:21:34.025199 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59650) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:34.105498 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59654) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:34.141013 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd7c1d1-2a94-4ee3-9776-58b30a60f5ca req-69aff770-0040-468c-8bbe-04a0b7d04252 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:34.150792 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4bd7c1d1-2a94-4ee3-9776-58b30a60f5ca req-69aff770-0040-468c-8bbe-04a0b7d04252 service neutron] 10.222.0.63 "GET /v2.0/networks?id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 HTTP/1.1" status: 200  len: 920 time: 0.5175731
May 31 16:21:34.245958 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port 321d16c6-0236-4519-8174-ad604590b1fc, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=321d16c6-0236-4519-8174-ad604590b1fc,segment=NetworkSegment(82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996),segment_id=82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:21:34.250705 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4bd7c1d1-2a94-4ee3-9776-58b30a60f5ca req-87d61358-b3d8-40e0-98c8-754654266de4 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=f99df66c-c850-4d01-80ae-3d312eee69db HTTP/1.1" status: 200  len: 217 time: 0.0898001
May 31 16:21:34.251876 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91764) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:21:34.263743 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] Sync routers for ids ['7928d30e-0100-4eb5-9431-cf404997bd15'] in dv-cinder-793814-1-iscsi {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:21:34.274130 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:34.280989 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:34.296041 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] Routers {'7928d30e-0100-4eb5-9431-cf404997bd15'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:21:34.296704 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426f134f0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:21:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['7928d30e-0100-4eb5-9431-cf404997bd15'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:34.361177 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1e671d9b-d14a-40ef-a78d-486b4eb9b9d6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:34.367737 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-6a4e2d7f-8c7a-4f07-84e3-cea36e92db5a admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=16e81170a75c4b11a58e6d70b30c98b7&name=default HTTP/1.1" status: 200  len: 2975 time: 0.2580199
May 31 16:21:34.368880 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59662) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:34.369692 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=321d16c6-0236-4519-8174-ad604590b1fc,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:34.406567 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:34.506202 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-cb894f4f-133f-4856-8327-c4a8ba3c931f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:34.528379 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1e671d9b-d14a-40ef-a78d-486b4eb9b9d6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:34.562112 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-cb894f4f-133f-4856-8327-c4a8ba3c931f None None] For port fce86ab6-1557-4a78-936b-fe27e15e00ac, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=fce86ab6-1557-4a78-936b-fe27e15e00ac,segment=NetworkSegment(44700c9f-b523-4212-86eb-cc7308ee0431),segment_id=44700c9f-b523-4212-86eb-cc7308ee0431)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:21:34.564637 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-75f1dcd7-37b7-461a-b62e-1df30283070f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:34.572403 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-cb894f4f-133f-4856-8327-c4a8ba3c931f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:34.574564 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-7c2099a7-a53e-43c0-abb2-83f008fd7384 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:34.692194 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Notify callbacks [] for router, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:34.694358 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201  len: 926 time: 7.0067515
May 31 16:21:34.699892 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59666) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:34.709220 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-75f1dcd7-37b7-461a-b62e-1df30283070f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:34.733744 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] Set router 7928d30e-0100-4eb5-9431-cf404997bd15 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:21:34.735787 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd7c1d1-2a94-4ee3-9776-58b30a60f5ca req-4a9c8c07-58e2-45c9-8531-796ef02e9e55 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:34.738173 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 321d16c6-0236-4519-8174-ad604590b1fc up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:34.740062 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4bd7c1d1-2a94-4ee3-9776-58b30a60f5ca req-4a9c8c07-58e2-45c9-8531-796ef02e9e55 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=b9c806fb-2a53-4445-8352-4336429eb043 HTTP/1.1" status: 200  len: 859 time: 0.4359403
May 31 16:21:34.810265 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb894f4f-133f-4856-8327-c4a8ba3c931f None None] Pushing event updated for resources: {'Port': ['ID=fce86ab6-1557-4a78-936b-fe27e15e00ac,revision_number=3']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:34.813830 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-cb894f4f-133f-4856-8327-c4a8ba3c931f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:34.831419 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 321d16c6-0236-4519-8174-ad604590b1fc triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:34.831854 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:34.846443 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4bd7c1d1-2a94-4ee3-9776-58b30a60f5ca req-46a7fa21-2c81-494a-ade4-4e30e30a4096 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0979710
May 31 16:21:34.920626 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-a8379592-2eb3-4add-9c7a-b6aa3beae052 None None] Provisioning complete for port fce86ab6-1557-4a78-936b-fe27e15e00ac triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:34.921745 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-a8379592-2eb3-4add-9c7a-b6aa3beae052 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:35.078580 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426f134f0>, [{'id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'name': 'tempest-TestMinimumBasicScenario-134910460-router', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182'}], 'enable_snat': True}, 'gw_port_id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:27Z', 'updated_at': '2021-05-31T16:21:30Z', 'revision_number': 3, 'project_id': '8e66b29e29094a429643e0308704753b', 'gw_port': {'id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:07:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_gateway', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:29Z', 'updated_at': '2021-05-31T16:21:29Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:35.083686 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] Checking router: 7928d30e-0100-4eb5-9431-cf404997bd15 for host: dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:21:35.084039 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] Updating router 7928d30e-0100-4eb5-9431-cf404997bd15 port a225a2ee-fc85-4ac1-9115-01b63bb0296a binding host dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 31 16:21:35.145204 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4bd7c1d1-2a94-4ee3-9776-58b30a60f5ca req-3c01a04b-c16f-467b-9f80-8537c4669f26 service neutron] 10.222.0.63 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2841334
May 31 16:21:35.153870 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:35.157466 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-e7e2a8a9-b911-4548-a875-109fd1bcc33f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:35.238698 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1e671d9b-d14a-40ef-a78d-486b4eb9b9d6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:35.303552 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:35.327791 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-75f1dcd7-37b7-461a-b62e-1df30283070f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:35.338097 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e671d9b-d14a-40ef-a78d-486b4eb9b9d6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=389798bc-55cf-4867-9603-fa79da525211,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:35.350691 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-1e671d9b-d14a-40ef-a78d-486b4eb9b9d6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:35.351199 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e58734b1-fe73-47a9-b9ae-c9805deec6ca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.014s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:35.367165 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1e671d9b-d14a-40ef-a78d-486b4eb9b9d6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:35.372059 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-1e671d9b-d14a-40ef-a78d-486b4eb9b9d6 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/389798bc-55cf-4867-9603-fa79da525211 HTTP/1.1" status: 204  len: 168 time: 1.3436766
May 31 16:21:35.376256 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75f1dcd7-37b7-461a-b62e-1df30283070f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=165e01bc-53ca-416e-93c5-98db294169b6,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:35.378563 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-75f1dcd7-37b7-461a-b62e-1df30283070f admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:35.380226 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-75f1dcd7-37b7-461a-b62e-1df30283070f admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/165e01bc-53ca-416e-93c5-98db294169b6 HTTP/1.1" status: 204  len: 168 time: 1.0097091
May 31 16:21:35.383803 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-75f1dcd7-37b7-461a-b62e-1df30283070f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:35.505205 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4bd7c1d1-2a94-4ee3-9776-58b30a60f5ca req-f5af5cfd-1b2f-4802-b06f-173370eff64e service neutron] 10.222.0.63 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3440225
May 31 16:21:35.543438 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8117fe0d-cb04-44d3-93f8-452097d1faf5 req-794d8c0c-c92d-4c89-8781-65f10d12f73b tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:35.562981 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8117fe0d-cb04-44d3-93f8-452097d1faf5 req-794d8c0c-c92d-4c89-8781-65f10d12f73b tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.3075135
May 31 16:21:35.673603 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 59694) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:35.747278 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8117fe0d-cb04-44d3-93f8-452097d1faf5 req-6ca3688b-0f82-4621-ad3f-16f6b50e1f1d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1814148
May 31 16:21:35.790924 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_v2 [None req-6e7c300b-0881-4690-90bf-2cdb7f2a5ef0 admin admin] Deleting subnet 98f9a0cd-16a5-484e-8a74-280b908828b9 {{(pid=91764) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 31 16:21:35.802221 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-6e7c300b-0881-4690-90bf-2cdb7f2a5ef0 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:35.837928 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] Notify callbacks [] for port, precommit_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:35.870433 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.provisioning_blocks [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] Transition to ACTIVE for port object a225a2ee-fc85-4ac1-9115-01b63bb0296a will not be triggered until provisioned by entity L2. {{(pid=91766) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:35.887908 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:35.893598 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-6e7c300b-0881-4690-90bf-2cdb7f2a5ef0 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:35.906373 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-e16f3546-bc9a-44ac-a3f0-0267e4fa78e1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:35.915258 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-6e7c300b-0881-4690-90bf-2cdb7f2a5ef0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-975336'] for subnet, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:36.032947 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] Attempting to bind port a225a2ee-fc85-4ac1-9115-01b63bb0296a on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:21:36.033322 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] Attempting to bind port a225a2ee-fc85-4ac1-9115-01b63bb0296a by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}] {{(pid=91766) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:21:36.033722 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] Attempting to bind port a225a2ee-fc85-4ac1-9115-01b63bb0296a on network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:21:36.042560 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e422f006-9a4f-411e-bb59-1fac6bd18879 None None] Pushing event updated for resources: {'Port': ['ID=a225a2ee-fc85-4ac1-9115-01b63bb0296a,revision_number=2']} {{(pid=91766) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:36.053300 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-e422f006-9a4f-411e-bb59-1fac6bd18879 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:36.056319 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 21, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:21:36.056692 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] Checking segment: {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91766) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:36.057136 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:36.057549 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] Bound using segment: {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'} {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:21:36.058064 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] Bound port: a225a2ee-fc85-4ac1-9115-01b63bb0296a, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}}] {{(pid=91766) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:21:36.058433 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:36.158346 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.db [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] For port a225a2ee-fc85-4ac1-9115-01b63bb0296a, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91766) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:21:36.173513 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.db [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] For port a225a2ee-fc85-4ac1-9115-01b63bb0296a, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=a225a2ee-fc85-4ac1-9115-01b63bb0296a,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91766) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:21:36.179313 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:36.195097 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-3d376f11-0bf2-4249-bf15-9e7aea789c45 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:36.273900 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] Routers {'7928d30e-0100-4eb5-9431-cf404997bd15'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:21:36.274458 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426f134f0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:21:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['7928d30e-0100-4eb5-9431-cf404997bd15'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:36.309232 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:36.379348 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e422f006-9a4f-411e-bb59-1fac6bd18879 None None] Pushing event updated for resources: {'Port': ['ID=a225a2ee-fc85-4ac1-9115-01b63bb0296a,revision_number=3']} {{(pid=91766) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:36.384569 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-e422f006-9a4f-411e-bb59-1fac6bd18879 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:36.476634 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-e3887a86-2475-4dd9-9cf3-a037297d6170 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:36.484222 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-e3887a86-2475-4dd9-9cf3-a037297d6170 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/networks?id=1097eeec-06a4-406d-ab4a-02e0123072d2 HTTP/1.1" status: 200  len: 814 time: 0.2969897
May 31 16:21:36.499461 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] Set router 7928d30e-0100-4eb5-9431-cf404997bd15 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:21:36.506584 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-cfa52cdd-ef9c-47ad-b12f-47c7101ff968 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/quotas/0eb6e65b3f844417816fb1e5c88a8004 HTTP/1.1" status: 200  len: 375 time: 0.0211506
May 31 16:21:36.553508 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-6e7c300b-0881-4690-90bf-2cdb7f2a5ef0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-978269', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357'] for subnet, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:36.570107 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-53e989af-6eb1-4af3-a093-09d502c67630 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:36.608265 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e7c300b-0881-4690-90bf-2cdb7f2a5ef0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=98f9a0cd-16a5-484e-8a74-280b908828b9,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:36.611906 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-6e7c300b-0881-4690-90bf-2cdb7f2a5ef0 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:36.615632 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-6e7c300b-0881-4690-90bf-2cdb7f2a5ef0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:36.632143 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-6e7c300b-0881-4690-90bf-2cdb7f2a5ef0 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/98f9a0cd-16a5-484e-8a74-280b908828b9 HTTP/1.1" status: 204  len: 168 time: 0.9459929
May 31 16:21:36.636378 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 59728) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:36.640356 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Allocated IP 172.20.0.1 (e3df5118-0a40-4a66-b31c-a978a0c899cf/1a675b0f-478f-47e0-acdd-51bacffe39b6/ec5c850b-3c95-4ae6-869b-87be2055c0aa) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:21:36.731227 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device fce86ab6-1557-4a78-936b-fe27e15e00ac up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:36.774358 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-41ce4d15-d3d9-401c-a288-f6c548a311ad tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=0eb6e65b3f844417816fb1e5c88a8004&fields=id HTTP/1.1" status: 200  len: 302 time: 0.2660615
May 31 16:21:36.906731 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port fce86ab6-1557-4a78-936b-fe27e15e00ac triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:36.907442 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:36.941211 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-525980'] for network, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:36.964111 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426f134f0>, [{'id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'name': 'tempest-TestMinimumBasicScenario-134910460-router', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182'}], 'enable_snat': True}, 'gw_port_id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:27Z', 'updated_at': '2021-05-31T16:21:30Z', 'revision_number': 3, 'project_id': '8e66b29e29094a429643e0308704753b', 'gw_port': {'id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:07:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_gateway', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:29Z', 'updated_at': '2021-05-31T16:21:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:36.964883 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-fe05d088-b353-4967-a649-e14cb084050b service neutron] 10.222.0.43 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1901584
May 31 16:21:36.968318 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:36.981270 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a638e4f-cacd-416d-ae57-1a39e20c3b44 None None] The sync data for ids ['7928d30e-0100-4eb5-9431-cf404997bd15'] in dv-cinder-793814-1-iscsi is: [{'id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'name': 'tempest-TestMinimumBasicScenario-134910460-router', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182'}], 'enable_snat': True}, 'gw_port_id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:27Z', 'updated_at': '2021-05-31T16:21:30Z', 'revision_number': 3, 'project_id': '8e66b29e29094a429643e0308704753b', 'gw_port': {'id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:07:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_gateway', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:29Z', 'updated_at': '2021-05-31T16:21:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}] {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:21:37.014381 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.provisioning_blocks [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Transition to ACTIVE for port object ec5c850b-3c95-4ae6-869b-87be2055c0aa will not be triggered until provisioned by entity DHCP. {{(pid=91763) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:37.052702 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:37.062991 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:37.140409 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Network e3df5118-0a40-4a66-b31c-a978a0c899cf is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:21:37.143360 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:37.149515 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:21:37.212468 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-16627828'] for router_interface, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:37.229073 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Pushing event updated for resources: {'Port': ['ID=ec5c850b-3c95-4ae6-869b-87be2055c0aa,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:37.237265 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:37.430732 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-988775', 'neutron.services.segments.db._delete_segments_for_network-8732784586204'] for network, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:37.465577 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7f1426184a60>> segment before_delete 55550000 {{(pid=91764) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:37.465577 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7f1426184a60>> subnet precommit_delete_associations 55550000 {{(pid=91764) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:37.466312 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f1426184c70>> segment_host_mapping after_create 55550000 {{(pid=91764) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:37.466678 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f1426184c70>> port after_create 55550000 {{(pid=91764) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:37.467001 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f1426184c70>> port after_delete 55550000 {{(pid=91764) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:37.467356 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f1426184c70>> port after_update 55550000 {{(pid=91764) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:37.467677 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f1426184c70>> segment after_delete 55550000 {{(pid=91764) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:37.467989 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f1426184c70>> subnet after_create 55550000 {{(pid=91764) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:37.468216 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:37.468717 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f1426184c70>> subnet after_delete 55550000 {{(pid=91764) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:37.468717 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f1426184c70>> subnet after_update 55550000 {{(pid=91764) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:37.494666 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-f47cfed3-ffee-4d59-904f-163deb675146 None None] Provisioning for port ec5c850b-3c95-4ae6-869b-87be2055c0aa completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:21:37.501129 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-f47cfed3-ffee-4d59-904f-163deb675146 None None] Provisioning complete for port ec5c850b-3c95-4ae6-869b-87be2055c0aa triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:37.501935 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f47cfed3-ffee-4d59-904f-163deb675146 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:37.540884 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f142634e460>> subnet after_create 55550000 {{(pid=91764) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:37.541273 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f142634e460>> subnet after_delete 55550000 {{(pid=91764) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:37.541636 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f142634e460>> subnet before_create 55550000 {{(pid=91764) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:37.541973 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f142634e460>> subnet before_update 55550000 {{(pid=91764) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 31 16:21:37.542344 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f1426184f40>,) {'filters': {'network_id': ['994ac3c2-7faa-4416-9efd-a0139199561a']}} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:37.575483 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f1426184f40>, '16d04e5d-5dfb-473e-b5b8-5041a96ac30f') {'for_net_delete': True} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:37.575692 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f1426184f40>, '16d04e5d-5dfb-473e-b5b8-5041a96ac30f') {} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:37.576391 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-f47cfed3-ffee-4d59-904f-163deb675146 None None] Port ec5c850b-3c95-4ae6-869b-87be2055c0aa cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:21:37.600031 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-82871664-1be5-486c-bf6e-8eaa81d029c4 service neutron] 10.222.0.43 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6167297
May 31 16:21:37.602225 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732784599197', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14907379'] for segment, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:37.626691 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:37.639059 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Releasing vlan 849 on physical network physnet1 to pool {{(pid=91764) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 31 16:21:37.639469 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14905732'] for segment, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:   from cryptography.utils import int_from_bytes
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:   from cryptography.utils import int_from_bytes
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]: Traceback (most recent call last):
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:     timer()
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:     cb(*args, **kw)
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:     return func(*args, **kwargs)
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:     self._notify()
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:     self.callback(batched_events)
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:     event.method(event)
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:     aggregate_uuid = self.p_client.list_aggregates(
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:     return f(self, *a, **k)
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self._get(url).json()
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self.request(url, 'GET', **kwargs)
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:     base_url = self.get_endpoint(auth, allow=allow,
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 31 16:21:37.660315 dv-cinder-793814-1-iscsi neutron-server[91764]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 31 16:21:37.675476 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0e92286-a8ff-41c4-8a01-d886a1336b18 req-ab06b63d-b5ac-49b0-99bf-cdebd28a6264 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:37.683425 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b0e92286-a8ff-41c4-8a01-d886a1336b18 req-ab06b63d-b5ac-49b0-99bf-cdebd28a6264 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.5994494
May 31 16:21:37.820645 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16621775'] for network, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:37.862170 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b0e92286-a8ff-41c4-8a01-d886a1336b18 req-79b446f1-0f69-452e-87d5-163571f14195 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1777353
May 31 16:21:37.865142 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c2e0bdd9-5585-4f6e-b52c-5e19933a5b5f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:37.865435 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:37.876172 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14337082'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:37.909498 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:37.915930 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:37.935538 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Pushing event deleted for resources: {'Network': ['ID=994ac3c2-7faa-4416-9efd-a0139199561a,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:37.939872 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:37.948256 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] 10.222.0.43 "DELETE /v2.0/networks/994ac3c2-7faa-4416-9efd-a0139199561a HTTP/1.1" status: 204  len: 168 time: 1.3069324
May 31 16:21:37.951950 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 59756) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:37.964238 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-8f956adc-4295-48ca-92e9-f941977c2086 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:38.013436 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-15a0adaf-edfb-48db-9d08-b08999b1ee20 req-783e6588-6091-4678-8419-f756b4b57f74 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=618a73da-df70-4028-8443-ff8667721881 HTTP/1.1" status: 200  len: 210 time: 0.0627935
May 31 16:21:38.070111 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-16310860', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-16627929'] for router_interface, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:38.126374 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Pushing event updated for resources: {'Port': ['ID=ec5c850b-3c95-4ae6-869b-87be2055c0aa,revision_number=2']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:38.134029 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:38.181227 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_v2 [None req-7a69cd8e-6a98-4314-b34c-341916fe4063 admin admin] Deleting subnet 8362573f-a246-46f9-a14b-65bf63130a75 {{(pid=91764) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 31 16:21:38.194476 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-7a69cd8e-6a98-4314-b34c-341916fe4063 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:38.234355 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-8caf981d-d009-4734-8148-88ddcf31283e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:38.314479 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-7a69cd8e-6a98-4314-b34c-341916fe4063 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14907384'] for subnet, precommit_delete_associations {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:38.371744 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Network e3df5118-0a40-4a66-b31c-a978a0c899cf is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:21:38.373905 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:38.401228 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-7a69cd8e-6a98-4314-b34c-341916fe4063 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-975336'] for subnet, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:38.722892 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-75932e66-bcdd-4f5a-988b-d155d0a18200 None None] Provisioning complete for port ec5c850b-3c95-4ae6-869b-87be2055c0aa triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:38.723971 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-75932e66-bcdd-4f5a-988b-d155d0a18200 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:38.774909 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device a225a2ee-fc85-4ac1-9115-01b63bb0296a up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:38.779674 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Router 7928d30e-0100-4eb5-9431-cf404997bd15 has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91763) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:21:38.930199 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-75932e66-bcdd-4f5a-988b-d155d0a18200 None None] Port ec5c850b-3c95-4ae6-869b-87be2055c0aa cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:21:38.937813 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-7a69cd8e-6a98-4314-b34c-341916fe4063 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-978269', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14907170', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14793691'] for subnet, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:38.942086 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:38.995967 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port a225a2ee-fc85-4ac1-9115-01b63bb0296a completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:21:39.000246 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a69cd8e-6a98-4314-b34c-341916fe4063 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8362573f-a246-46f9-a14b-65bf63130a75,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:39.008883 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-7a69cd8e-6a98-4314-b34c-341916fe4063 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:39.015831 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-7a69cd8e-6a98-4314-b34c-341916fe4063 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:39.018682 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port a225a2ee-fc85-4ac1-9115-01b63bb0296a triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:39.019442 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:39.028389 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59776) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:39.028566 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-7a69cd8e-6a98-4314-b34c-341916fe4063 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/8362573f-a246-46f9-a14b-65bf63130a75 HTTP/1.1" status: 204  len: 168 time: 1.0754745
May 31 16:21:39.065908 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:21:39.170309 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:39.187107 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-10e3a15e-ab08-48da-81a1-81548e1b9214 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-525980'] for network, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:39.187992 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-749592f7-5b37-4fed-b7f4-1df05171fc6d req-51c6c081-f8fd-4cf7-88e7-548c5528165e tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:39.190868 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-749592f7-5b37-4fed-b7f4-1df05171fc6d req-51c6c081-f8fd-4cf7-88e7-548c5528165e tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.1011584
May 31 16:21:39.209590 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] 10.222.0.43 "PUT /v2.0/routers/7928d30e-0100-4eb5-9431-cf404997bd15/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.5010059
May 31 16:21:39.219265 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:39.236362 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port a225a2ee-fc85-4ac1-9115-01b63bb0296a, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=a225a2ee-fc85-4ac1-9115-01b63bb0296a,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:21:39.245006 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:39.250188 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-cb894f4f-133f-4856-8327-c4a8ba3c931f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:39.357675 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=a225a2ee-fc85-4ac1-9115-01b63bb0296a,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:39.363568 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:39.366280 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-10e3a15e-ab08-48da-81a1-81548e1b9214 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-988775', 'neutron.services.segments.db._delete_segments_for_network-8732784586204'] for network, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:39.380227 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-749592f7-5b37-4fed-b7f4-1df05171fc6d req-a6941305-58ea-4b39-aa3c-de3dbf2bdcca tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1833420
May 31 16:21:39.387784 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ba9a069b-4461-407a-984c-e7b042fa2b6d req-533a2911-4070-4d26-8fde-e2aa36d9a861 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=618a73da-df70-4028-8443-ff8667721881 HTTP/1.1" status: 200  len: 210 time: 0.1128008
May 31 16:21:39.390022 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-10e3a15e-ab08-48da-81a1-81548e1b9214 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f1426250c70>,) {'filters': {'network_id': ['f30be21a-c39e-4fce-8c00-5f877e95758a']}} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:39.407547 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-10e3a15e-ab08-48da-81a1-81548e1b9214 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f1426250c70>, '36a7ddf9-92d3-4847-ad54-1a002be7e2aa') {'for_net_delete': True} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:39.407852 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-10e3a15e-ab08-48da-81a1-81548e1b9214 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f1426250c70>, '36a7ddf9-92d3-4847-ad54-1a002be7e2aa') {} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:39.433681 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-10e3a15e-ab08-48da-81a1-81548e1b9214 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732784599197', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15104868'] for segment, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:39.446584 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] Sync routers for ids ['7928d30e-0100-4eb5-9431-cf404997bd15'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:21:39.459604 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-10e3a15e-ab08-48da-81a1-81548e1b9214 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:39.467198 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-10e3a15e-ab08-48da-81a1-81548e1b9214 admin admin] Releasing vlan 835 on physical network physnet1 to pool {{(pid=91763) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 31 16:21:39.467767 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-10e3a15e-ab08-48da-81a1-81548e1b9214 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14337126'] for segment, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:39.487208 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] Routers {'7928d30e-0100-4eb5-9431-cf404997bd15'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:21:39.487859 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f142635ddf0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:21:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['7928d30e-0100-4eb5-9431-cf404997bd15'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]: Traceback (most recent call last):
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:     timer()
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:     cb(*args, **kw)
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:     return func(*args, **kwargs)
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:     self._notify()
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:     self.callback(batched_events)
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:     event.method(event)
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:     aggregate_uuid = self.p_client.list_aggregates(
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:     return f(self, *a, **k)
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self._get(url).json()
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self.request(url, 'GET', **kwargs)
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:     base_url = self.get_endpoint(auth, allow=allow,
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 31 16:21:39.492477 dv-cinder-793814-1-iscsi neutron-server[91763]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 31 16:21:39.599897 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-10e3a15e-ab08-48da-81a1-81548e1b9214 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16621775'] for network, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:39.604157 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-07b396d9-7d80-4c9d-90a8-f8760b9a8e22 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:39.646732 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-10e3a15e-ab08-48da-81a1-81548e1b9214 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:39.654039 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10e3a15e-ab08-48da-81a1-81548e1b9214 admin admin] Pushing event deleted for resources: {'Network': ['ID=f30be21a-c39e-4fce-8c00-5f877e95758a,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:39.658587 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-10e3a15e-ab08-48da-81a1-81548e1b9214 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:39.665300 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-10e3a15e-ab08-48da-81a1-81548e1b9214 admin admin] 10.222.0.43 "DELETE /v2.0/networks/f30be21a-c39e-4fce-8c00-5f877e95758a HTTP/1.1" status: 204  len: 168 time: 0.6293092
May 31 16:21:39.742163 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-1f2d7653-c5f2-4ff6-a5f0-5cd89ba8c415 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:39.744065 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-1f2d7653-c5f2-4ff6-a5f0-5cd89ba8c415 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.63 "GET /v2.0/networks?id=1097eeec-06a4-406d-ab4a-02e0123072d2 HTTP/1.1" status: 200  len: 814 time: 0.3088479
May 31 16:21:39.767332 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-3c657a59-1db6-43d2-8b14-9d151a6a238b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Request body: {'port': {'device_id': '618a73da-df70-4028-8443-ff8667721881', 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2', 'admin_state_up': True, 'tenant_id': '0eb6e65b3f844417816fb1e5c88a8004'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:39.831080 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] Set router 7928d30e-0100-4eb5-9431-cf404997bd15 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:21:39.971327 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-3c657a59-1db6-43d2-8b14-9d151a6a238b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:39.998134 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-3c657a59-1db6-43d2-8b14-9d151a6a238b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:40.018691 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59804) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:40.030009 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-3c657a59-1db6-43d2-8b14-9d151a6a238b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Made reservation on behalf of 0eb6e65b3f844417816fb1e5c88a8004 for: {'port': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:21:40.033506 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-3c657a59-1db6-43d2-8b14-9d151a6a238b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:40.084577 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-48cb9a80-2c0a-49c4-be4a-2f8b7d19fe9b admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=9f1c6309b90340f4bb161faff600d196&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0643737
May 31 16:21:40.086926 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59808) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:40.195227 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-48524319-c07c-489c-98a5-f7510a623617 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:40.236437 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-48524319-c07c-489c-98a5-f7510a623617 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:40.259095 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f142635ddf0>, [{'id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'name': 'tempest-TestMinimumBasicScenario-134910460-router', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182'}], 'enable_snat': True}, 'gw_port_id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:27Z', 'updated_at': '2021-05-31T16:21:37Z', 'revision_number': 4, 'project_id': '8e66b29e29094a429643e0308704753b', 'gw_port': {'id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:07:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_gateway', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:29Z', 'updated_at': '2021-05-31T16:21:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': 'ec5c850b-3c95-4ae6-869b-87be2055c0aa', 'name': '', 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'mac_address': 'fa:16:3e:cb:c9:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_interface', 'standard_attr_id': 328, 'fixed_ips': [{'subnet_id': '1a675b0f-478f-47e0-acdd-51bacffe39b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:36Z', 'updated_at': '2021-05-31T16:21:37Z', 'revision_number': 2, 'project_id': '8e66b29e29094a429643e0308704753b', 'subnets': [{'id': '1a675b0f-478f-47e0-acdd-51bacffe39b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:40.264006 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] Checking router: 7928d30e-0100-4eb5-9431-cf404997bd15 for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:21:40.264374 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] Updating router 7928d30e-0100-4eb5-9431-cf404997bd15 port ec5c850b-3c95-4ae6-869b-87be2055c0aa binding host dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 31 16:21:40.291075 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-3c657a59-1db6-43d2-8b14-9d151a6a238b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Allocated IP 172.20.0.7 (1097eeec-06a4-406d-ab4a-02e0123072d2/68c4d303-4299-4977-888e-57c80b8530cc/a94146eb-55eb-45df-b975-f2732f9d455d) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:21:40.305000 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 59820) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:40.324050 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-348591781-network', 'tenant_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:40.331123 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-48524319-c07c-489c-98a5-f7510a623617 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:40.333339 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:40.343495 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-54c693f8-178e-4c3b-bfb7-ab49fda04245 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:40.351131 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Usage tracker for resource:network and tenant:b8bc8f93c5a94a43bcb5b1f62b1e677f is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:40.356882 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:40.374553 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:40.379969 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48524319-c07c-489c-98a5-f7510a623617 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4f8959c5-9563-4d9f-9b73-60d7bb2842ce,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:40.381350 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:40.394682 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-48524319-c07c-489c-98a5-f7510a623617 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:40.398091 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-48524319-c07c-489c-98a5-f7510a623617 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:40.404158 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-48524319-c07c-489c-98a5-f7510a623617 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/4f8959c5-9563-4d9f-9b73-60d7bb2842ce HTTP/1.1" status: 204  len: 168 time: 0.3141077
May 31 16:21:40.414952 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Made reservation on behalf of b8bc8f93c5a94a43bcb5b1f62b1e677f for: {'network': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:21:40.416546 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-639279'] for network, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:40.439109 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:40.534147 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:40.553094 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Usage tracker for resource:security_group_rule and tenant:b8bc8f93c5a94a43bcb5b1f62b1e677f is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:40.570486 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:40.686274 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device a225a2ee-fc85-4ac1-9115-01b63bb0296a up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:40.772679 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:40.807681 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port a225a2ee-fc85-4ac1-9115-01b63bb0296a triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:40.808063 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:40.814815 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f84ee5ca-9898-4d86-8bec-82e691d1159f req-aa388a17-8333-47bd-91eb-67ccee1d2975 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=618a73da-df70-4028-8443-ff8667721881 HTTP/1.1" status: 200  len: 210 time: 0.2316782
May 31 16:21:40.906348 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-3c657a59-1db6-43d2-8b14-9d151a6a238b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:40.945119 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:40.968344 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9f036fe-f561-488d-a8cd-ab3bfad72b36 req-52e6f03b-2f47-478c-bc81-9d9302b941fa tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:40.977573 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d9f036fe-f561-488d-a8cd-ab3bfad72b36 req-52e6f03b-2f47-478c-bc81-9d9302b941fa tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.2581859
May 31 16:21:40.988253 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] Notify callbacks [] for port, precommit_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:41.008053 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] Transition to ACTIVE for port object ec5c850b-3c95-4ae6-869b-87be2055c0aa will not be triggered until provisioned by entity L2. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:41.031147 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59844) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:41.061856 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:41.074808 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:41.088850 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d9f036fe-f561-488d-a8cd-ab3bfad72b36 req-a37596f3-5a22-40b4-8c7b-4b52d0968cf2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1103263
May 31 16:21:41.104117 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-e361847d-6b7e-4a9d-8e43-e603734e059f admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=f1f8f5730e8e49ffb9caa3a72d8c35e7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0703053
May 31 16:21:41.109583 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-3c657a59-1db6-43d2-8b14-9d151a6a238b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:41.109583 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 59848) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:41.138050 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['5591c8db-5905-4285-84f7-5743de100fc2', 'a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:21:41.138593 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:41.139594 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-d84ec3bd-f801-4689-bfc5-aa3c8c9bc5a6 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:41.200237 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:41.245049 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-3c657a59-1db6-43d2-8b14-9d151a6a238b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Network 1097eeec-06a4-406d-ab4a-02e0123072d2 is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:21:41.252092 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-3c657a59-1db6-43d2-8b14-9d151a6a238b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:41.254867 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-3c657a59-1db6-43d2-8b14-9d151a6a238b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:21:41.330976 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 804}  {{(pid=91764) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 31 16:21:41.346028 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ffe1939-f5e2-41a9-9101-05472b88f80b None None] Pushing event updated for resources: {'Port': ['ID=ec5c850b-3c95-4ae6-869b-87be2055c0aa,revision_number=3']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:41.359804 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-3ffe1939-f5e2-41a9-9101-05472b88f80b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.285s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:41.368918 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c657a59-1db6-43d2-8b14-9d151a6a238b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Pushing event updated for resources: {'Port': ['ID=a94146eb-55eb-45df-b975-f2732f9d455d,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:41.379002 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:41.379864 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.db.segments_db [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Added segment b72084f1-c698-4897-bb6d-f45dadd02fbd of type vlan for network ebb8f1cc-6c15-416d-995e-90978c0e9eac
May 31 16:21:41.386186 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-3c657a59-1db6-43d2-8b14-9d151a6a238b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:41.386814 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-3c657a59-1db6-43d2-8b14-9d151a6a238b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:41.400313 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-3c657a59-1db6-43d2-8b14-9d151a6a238b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.261s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:41.405051 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.184s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:41.435899 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b24f1b94-6b50-4b61-9488-fc7809569b5f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:41.464127 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] Attempting to bind port ec5c850b-3c95-4ae6-869b-87be2055c0aa on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:21:41.464416 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] Attempting to bind port ec5c850b-3c95-4ae6-869b-87be2055c0aa by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '44700c9f-b523-4212-86eb-cc7308ee0431', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 808, 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf'}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:21:41.464785 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] Attempting to bind port ec5c850b-3c95-4ae6-869b-87be2055c0aa on network e3df5118-0a40-4a66-b31c-a978a0c899cf {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:21:41.481486 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 21, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:21:41.481904 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] Checking segment: {'id': '44700c9f-b523-4212-86eb-cc7308ee0431', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 808, 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91765) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:41.482339 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:41.482765 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] Bound using segment: {'id': '44700c9f-b523-4212-86eb-cc7308ee0431', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 808, 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf'} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:21:41.483612 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] Bound port: ec5c850b-3c95-4ae6-869b-87be2055c0aa, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44700c9f-b523-4212-86eb-cc7308ee0431', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 808, 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf'}}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:21:41.484490 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:41.492239 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c3467fea-2498-41e3-aeb8-e428960dfb35,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:41.512046 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:41.514698 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732784079930'] for network, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:41.523324 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b24f1b94-6b50-4b61-9488-fc7809569b5f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:41.531072 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-3c657a59-1db6-43d2-8b14-9d151a6a238b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.63 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.7744234
May 31 16:21:41.557046 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Request body: {'port': {'device_id': '618a73da-df70-4028-8443-ff8667721881', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79381'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:41.666739 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] For port ec5c850b-3c95-4ae6-869b-87be2055c0aa, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91765) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:21:41.674255 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] For port ec5c850b-3c95-4ae6-869b-87be2055c0aa, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=ec5c850b-3c95-4ae6-869b-87be2055c0aa,segment=NetworkSegment(44700c9f-b523-4212-86eb-cc7308ee0431),segment_id=44700c9f-b523-4212-86eb-cc7308ee0431)] {{(pid=91765) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:21:41.680325 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366'] for network, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:41.682370 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:41.687422 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:41.688003 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:41.695403 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:41.700666 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:41.724779 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b24f1b94-6b50-4b61-9488-fc7809569b5f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:41.819763 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:41.838927 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] Routers {'7928d30e-0100-4eb5-9431-cf404997bd15'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:21:41.840867 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f142635ddf0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:21:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['7928d30e-0100-4eb5-9431-cf404997bd15'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:41.840993 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b24f1b94-6b50-4b61-9488-fc7809569b5f admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:41.845678 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-b24f1b94-6b50-4b61-9488-fc7809569b5f admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/b45bcc60-e9a6-4f12-9b50-f94a6e14d9d4 HTTP/1.1" status: 204  len: 168 time: 0.7328722
May 31 16:21:41.880903 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 1.5742204
May 31 16:21:41.884089 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59860) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:41.891429 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-06367b85-1d3f-4ed7-939b-8796c94b0376 admin admin] Request body: {'subnet': {'network_id': 'ebb8f1cc-6c15-416d-995e-90978c0e9eac', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-348591781-subnet', 'tenant_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'ip_version': 4}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:41.900970 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-06367b85-1d3f-4ed7-939b-8796c94b0376 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:41.914970 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-06367b85-1d3f-4ed7-939b-8796c94b0376 admin admin] Usage tracker for resource:subnet and tenant:b8bc8f93c5a94a43bcb5b1f62b1e677f is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:41.925007 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-06367b85-1d3f-4ed7-939b-8796c94b0376 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:41.934176 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Pushing event updated for resources: {'Network': ['ID=ebb8f1cc-6c15-416d-995e-90978c0e9eac,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:41.935699 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-06367b85-1d3f-4ed7-939b-8796c94b0376 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:41.967279 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-06367b85-1d3f-4ed7-939b-8796c94b0376 admin admin] Made reservation on behalf of b8bc8f93c5a94a43bcb5b1f62b1e677f for: {'subnet': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:21:41.970908 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-06367b85-1d3f-4ed7-939b-8796c94b0376 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-13992668'] for subnet, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:42.013420 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.313s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:42.026310 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ffe1939-f5e2-41a9-9101-05472b88f80b None None] Pushing event updated for resources: {'Port': ['ID=ec5c850b-3c95-4ae6-869b-87be2055c0aa,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:42.034028 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-3ffe1939-f5e2-41a9-9101-05472b88f80b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.338s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:42.044416 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.308s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:42.066229 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Network ebb8f1cc-6c15-416d-995e-90978c0e9eac details requested by agent ovs-agent-dv-cinder-793814-1-iscsi with host dv-cinder-793814-1-iscsi {{(pid=91765) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 31 16:21:42.274409 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b24f1b94-6b50-4b61-9488-fc7809569b5f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b45bcc60-e9a6-4f12-9b50-f94a6e14d9d4,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:42.523573 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] Set router 7928d30e-0100-4eb5-9431-cf404997bd15 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:21:42.595124 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-b24f1b94-6b50-4b61-9488-fc7809569b5f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.550s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:42.773234 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebca6d0-f0c4-4fe9-b563-c0c20a95ee06 req-ce7f062e-285a-4afd-9d55-9e0bee9c47f9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:42.774078 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-7ebca6d0-f0c4-4fe9-b563-c0c20a95ee06 req-ce7f062e-285a-4afd-9d55-9e0bee9c47f9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Synchronizing usage tracker for tenant:0eb6e65b3f844417816fb1e5c88a8004 on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:21:42.776547 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-06367b85-1d3f-4ed7-939b-8796c94b0376 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-14336643', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-13992650'] for subnet, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:42.784148 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d7fcd0c1-f110-45a7-aa49-92aa8d7bcb7c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:42.789309 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b273b89a-f8b0-4a3f-b3eb-6885d6eeb6b9 req-8bd7db99-657f-4a84-b62c-bbb684f0c3b2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:42.790905 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b273b89a-f8b0-4a3f-b3eb-6885d6eeb6b9 req-8bd7db99-657f-4a84-b62c-bbb684f0c3b2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.4995229
May 31 16:21:42.885582 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-7ebca6d0-f0c4-4fe9-b563-c0c20a95ee06 req-ce7f062e-285a-4afd-9d55-9e0bee9c47f9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Unset dirty status for tenant:0eb6e65b3f844417816fb1e5c88a8004 on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:21:42.888839 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06367b85-1d3f-4ed7-939b-8796c94b0376 admin admin] Pushing event updated for resources: {'Subnet': ['ID=19349b15-7a29-4559-912d-95f2c3f6c489,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:42.892193 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7ebca6d0-f0c4-4fe9-b563-c0c20a95ee06 req-ce7f062e-285a-4afd-9d55-9e0bee9c47f9 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=618a73da-df70-4028-8443-ff8667721881 HTTP/1.1" status: 200  len: 931 time: 0.5844080
May 31 16:21:42.894383 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-06367b85-1d3f-4ed7-939b-8796c94b0376 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:42.903193 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06367b85-1d3f-4ed7-939b-8796c94b0376 admin admin] Checking segment: {'id': 'b72084f1-c698-4897-bb6d-f45dadd02fbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 804, 'network_id': 'ebb8f1cc-6c15-416d-995e-90978c0e9eac'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91763) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:42.903555 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-06367b85-1d3f-4ed7-939b-8796c94b0376 admin admin] Network hostable DHCP agents. Network: ebb8f1cc-6c15-416d-995e-90978c0e9eac, hostable agents: ['5c9859e8-5965-4c86-8b2b-8fab235cbf66'], hosted agents: [] {{(pid=91763) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 31 16:21:42.932020 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-06367b85-1d3f-4ed7-939b-8796c94b0376 admin admin] Network ebb8f1cc-6c15-416d-995e-90978c0e9eac is scheduled to be hosted by DHCP agent 5c9859e8-5965-4c86-8b2b-8fab235cbf66 with binding_index 1 {{(pid=91763) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 31 16:21:42.936025 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a94146eb-55eb-45df-b975-f2732f9d455d {{(pid=91764) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:21:42.947450 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-06367b85-1d3f-4ed7-939b-8796c94b0376 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793814-1-iscsi, ebb8f1cc-6c15-416d-995e-90978c0e9eac) {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:42.950823 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Notify callbacks [] for port, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:42.960206 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-06367b85-1d3f-4ed7-939b-8796c94b0376 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:42.962310 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-06367b85-1d3f-4ed7-939b-8796c94b0376 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:42.969643 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b273b89a-f8b0-4a3f-b3eb-6885d6eeb6b9 req-00652a19-2055-413d-9929-5575a30a7d05 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1189969
May 31 16:21:43.009513 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7ebca6d0-f0c4-4fe9-b563-c0c20a95ee06 req-0b552ce4-445d-48bc-a194-7a2337f6106c tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1163592
May 31 16:21:43.011110 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-06367b85-1d3f-4ed7-939b-8796c94b0376 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 850 time: 1.1253252
May 31 16:21:43.011733 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59890) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:43.021101 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.provisioning_blocks [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Transition to ACTIVE for port object a94146eb-55eb-45df-b975-f2732f9d455d will not be triggered until provisioned by entity L2. {{(pid=91764) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:43.024790 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-573cbe56-c47f-44e8-9bff-5fbd8394e561 None None] Network ebb8f1cc-6c15-416d-995e-90978c0e9eac requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:21:43.028437 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-348591781-router', 'tenant_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:43.032891 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:43.039611 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:43.048809 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:43.060789 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Usage tracker for resource:router and tenant:b8bc8f93c5a94a43bcb5b1f62b1e677f is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:43.068985 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:43.086031 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:43.112016 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-16623804', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-697'] for router, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:43.113833 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-16618684', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-16621667', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-16430734', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-672'] for router, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:43.149407 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:43.472230 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp87ca72be-1027-56d4-a8d3-ba9dae998815-ebb8f1cc-6c15-416d-995e-90978c0e9eac', 'network_id': 'ebb8f1cc-6c15-416d-995e-90978c0e9eac', 'tenant_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'fixed_ips': [{'subnet_id': '19349b15-7a29-4559-912d-95f2c3f6c489'}]}} from dv-cinder-793814-1-iscsi. {{(pid=91765) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 31 16:21:43.474539 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:43.479827 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Pushing event updated for resources: {'Port': ['ID=a94146eb-55eb-45df-b975-f2732f9d455d,revision_number=2']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:43.490427 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f142635ddf0>, [{'id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'name': 'tempest-TestMinimumBasicScenario-134910460-router', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182'}], 'enable_snat': True}, 'gw_port_id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:27Z', 'updated_at': '2021-05-31T16:21:37Z', 'revision_number': 4, 'project_id': '8e66b29e29094a429643e0308704753b', 'gw_port': {'id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:07:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_gateway', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:29Z', 'updated_at': '2021-05-31T16:21:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': 'ec5c850b-3c95-4ae6-869b-87be2055c0aa', 'name': '', 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'mac_address': 'fa:16:3e:cb:c9:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_interface', 'standard_attr_id': 328, 'fixed_ips': [{'subnet_id': '1a675b0f-478f-47e0-acdd-51bacffe39b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:36Z', 'updated_at': '2021-05-31T16:21:41Z', 'revision_number': 4, 'project_id': '8e66b29e29094a429643e0308704753b', 'subnets': [{'id': '1a675b0f-478f-47e0-acdd-51bacffe39b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:43.502061 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4075a48e-b2f8-4b45-8e1a-2fe7ddcf25e4 None None] The sync data for ids ['7928d30e-0100-4eb5-9431-cf404997bd15'] in dv-cinder-793814-1-iscsi is: [{'id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'name': 'tempest-TestMinimumBasicScenario-134910460-router', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182'}], 'enable_snat': True}, 'gw_port_id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:27Z', 'updated_at': '2021-05-31T16:21:37Z', 'revision_number': 4, 'project_id': '8e66b29e29094a429643e0308704753b', 'gw_port': {'id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:07:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_gateway', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:29Z', 'updated_at': '2021-05-31T16:21:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': 'ec5c850b-3c95-4ae6-869b-87be2055c0aa', 'name': '', 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'mac_address': 'fa:16:3e:cb:c9:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_interface', 'standard_attr_id': 328, 'fixed_ips': [{'subnet_id': '1a675b0f-478f-47e0-acdd-51bacffe39b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:36Z', 'updated_at': '2021-05-31T16:21:41Z', 'revision_number': 4, 'project_id': '8e66b29e29094a429643e0308704753b', 'subnets': [{'id': '1a675b0f-478f-47e0-acdd-51bacffe39b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:21:43.503847 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.464s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:43.526101 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Attempting to bind port a94146eb-55eb-45df-b975-f2732f9d455d on host hv-cinder-79381 for vnic_type normal with profile  {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:21:43.526440 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Attempting to bind port a94146eb-55eb-45df-b975-f2732f9d455d by drivers openvswitch,hyperv on host hv-cinder-79381 at level 0 using segments [{'id': '016e9daa-b906-4ec8-978d-cb58fbcd78da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2'}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:21:43.526887 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Attempting to bind port a94146eb-55eb-45df-b975-f2732f9d455d on network 1097eeec-06a4-406d-ab4a-02e0123072d2 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:21:43.532960 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Port a94146eb-55eb-45df-b975-f2732f9d455d on network 1097eeec-06a4-406d-ab4a-02e0123072d2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79381 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 31 16:21:43.533313 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Attempting to bind port a94146eb-55eb-45df-b975-f2732f9d455d on network 1097eeec-06a4-406d-ab4a-02e0123072d2 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:21:43.540535 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Checking agent: {'id': '4bed2638-4d91-4afb-bf81-aacca8584621', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79381', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'started_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 21, 20), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:21:43.540915 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Checking segment: {'id': '016e9daa-b906-4ec8-978d-cb58fbcd78da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:43.541274 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Bound using segment: {'id': '016e9daa-b906-4ec8-978d-cb58fbcd78da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2'} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:21:43.541765 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Bound port: a94146eb-55eb-45df-b975-f2732f9d455d, host: hv-cinder-79381, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '016e9daa-b906-4ec8-978d-cb58fbcd78da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2'}}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:21:43.542115 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:43.641370 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16621638', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16623758', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-722'] for router, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:43.794214 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] For port a94146eb-55eb-45df-b975-f2732f9d455d, host hv-cinder-79381, cleared binding levels {{(pid=91764) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:21:43.809228 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] For port a94146eb-55eb-45df-b975-f2732f9d455d, host hv-cinder-79381, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=a94146eb-55eb-45df-b975-f2732f9d455d,segment=NetworkSegment(016e9daa-b906-4ec8-978d-cb58fbcd78da),segment_id=016e9daa-b906-4ec8-978d-cb58fbcd78da)] {{(pid=91764) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:21:43.819223 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:43.824472 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:43.844516 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.db_base_plugin_common [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Allocated IP 172.20.0.2 (ebb8f1cc-6c15-416d-995e-90978c0e9eac/19349b15-7a29-4559-912d-95f2c3f6c489/e9ece5ff-8846-4f48-8d10-1021be81f9e5) {{(pid=91765) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:21:43.856210 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59904) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:44.243330 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-65e25d73-1d8e-46db-a79d-af6beb622d74 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:44.302475 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-65e25d73-1d8e-46db-a79d-af6beb622d74 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:44.320318 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-65e25d73-1d8e-46db-a79d-af6beb622d74 admin admin] Usage tracker for resource:security_group_rule and tenant:b39a9128569f4cffa7ce36ae4b05bf2c is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:44.323695 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:44.385926 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-65e25d73-1d8e-46db-a79d-af6beb622d74 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:44.409056 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-65e25d73-1d8e-46db-a79d-af6beb622d74 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:44.419165 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:44.435094 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:44.436393 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:44.441512 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] 10.222.0.63 "PUT /v2.0/ports/a94146eb-55eb-45df-b975-f2732f9d455d HTTP/1.1" status: 200  len: 1093 time: 2.8965333
May 31 16:21:44.443530 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '618a73da-df70-4028-8443-ff8667721881', 'tag': 'a94146eb-55eb-45df-b975-f2732f9d455d'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:21:44.448863 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5c2ede30-a25f-4e97-bdd2-556452a4393e" -d '{"events": [{"name": "network-changed", "server_uuid": "618a73da-df70-4028-8443-ff8667721881", "tag": "a94146eb-55eb-45df-b975-f2732f9d455d"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:21:44.455570 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Notify callbacks [] for port, precommit_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:44.492779 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Transition to ACTIVE for port object e9ece5ff-8846-4f48-8d10-1021be81f9e5 will not be triggered until provisioned by entity L2. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:44.530224 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Pushing event updated for resources: {'Port': ['ID=a94146eb-55eb-45df-b975-f2732f9d455d,revision_number=3']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:44.531562 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Transition to ACTIVE for port object e9ece5ff-8846-4f48-8d10-1021be81f9e5 will not be triggered until provisioned by entity DHCP. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:44.546158 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:44.546710 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.722s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:44.558899 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-f19e1463-1c08-4ed2-be05-108c08d82783 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:44.700096 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Pushing event updated for resources: {'Port': ['ID=e9ece5ff-8846-4f48-8d10-1021be81f9e5,revision_number=1']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:44.703779 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:44.717225 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Network ebb8f1cc-6c15-416d-995e-90978c0e9eac is already hosted by enough agents. {{(pid=91765) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:21:44.718626 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.scheduler.base_scheduler [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Resources bound (agent type, host, resource id):  {{(pid=91765) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:44.725963 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Received port after_create {{(pid=91765) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:21:44.827134 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device ec5c850b-3c95-4ae6-869b-87be2055c0aa up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:44.849101 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07174789-023c-4a24-b066-db04d86de9a1 req-4cc62eb8-095a-4cf2-8072-2c1118034e66 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:44.857101 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-07174789-023c-4a24-b066-db04d86de9a1 req-4cc62eb8-095a-4cf2-8072-2c1118034e66 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.3014596
May 31 16:21:44.884302 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-a0ac2359-1bbb-4574-9a22-fe7ecc7b9056 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:44.886176 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-a0ac2359-1bbb-4574-9a22-fe7ecc7b9056 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=0eb6e65b3f844417816fb1e5c88a8004&device_id=618a73da-df70-4028-8443-ff8667721881 HTTP/1.1" status: 200  len: 1096 time: 0.2282186
May 31 16:21:44.961394 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Attempting to bind port e9ece5ff-8846-4f48-8d10-1021be81f9e5 on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:21:44.962606 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Attempting to bind port e9ece5ff-8846-4f48-8d10-1021be81f9e5 by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': 'b72084f1-c698-4897-bb6d-f45dadd02fbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 804, 'network_id': 'ebb8f1cc-6c15-416d-995e-90978c0e9eac'}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:21:44.963228 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Attempting to bind port e9ece5ff-8846-4f48-8d10-1021be81f9e5 on network ebb8f1cc-6c15-416d-995e-90978c0e9eac {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:21:44.984233 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 21, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:21:44.985037 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Checking segment: {'id': 'b72084f1-c698-4897-bb6d-f45dadd02fbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 804, 'network_id': 'ebb8f1cc-6c15-416d-995e-90978c0e9eac'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91765) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:44.985734 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:44.986370 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Bound using segment: {'id': 'b72084f1-c698-4897-bb6d-f45dadd02fbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 804, 'network_id': 'ebb8f1cc-6c15-416d-995e-90978c0e9eac'} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:21:44.987113 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Bound port: e9ece5ff-8846-4f48-8d10-1021be81f9e5, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b72084f1-c698-4897-bb6d-f45dadd02fbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 804, 'network_id': 'ebb8f1cc-6c15-416d-995e-90978c0e9eac'}}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:21:44.987724 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:45.038800 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-07174789-023c-4a24-b066-db04d86de9a1 req-dcb76991-8241-4ae9-a5fa-729132ceb064 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1803567
May 31 16:21:45.053638 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-f51a1bcc-dccf-4a87-925d-12f4fe531267 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=a94146eb-55eb-45df-b975-f2732f9d455d HTTP/1.1" status: 200  len: 217 time: 0.1408660
May 31 16:21:45.104339 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Allocated IP 172.27.0.70 (00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c/96709d85-d0fe-4cf8-b232-eaf6b143ebe6/2f39560e-c0eb-445a-ab3c-55c4c613178f) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:21:45.127718 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-65e25d73-1d8e-46db-a79d-af6beb622d74 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:45.157787 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-65e25d73-1d8e-46db-a79d-af6beb622d74 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:45.162353 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] For port e9ece5ff-8846-4f48-8d10-1021be81f9e5, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91765) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:21:45.169400 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] For port e9ece5ff-8846-4f48-8d10-1021be81f9e5, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=e9ece5ff-8846-4f48-8d10-1021be81f9e5,segment=NetworkSegment(b72084f1-c698-4897-bb6d-f45dadd02fbd),segment_id=b72084f1-c698-4897-bb6d-f45dadd02fbd)] {{(pid=91765) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:21:45.172488 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-2e963c72-d971-40a7-9dc5-3d957a67c90a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:45.194003 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:45.211756 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:45.224615 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65e25d73-1d8e-46db-a79d-af6beb622d74 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=00412b4b-df7a-4a14-b4ed-947c10a9e1d8,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:45.237692 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a48f1f2b-57c8-482b-bc10-3d8e7e4777c5 req-f76251d5-1ee4-49f2-bc5f-f63c4c8dfaed tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:45.240445 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a48f1f2b-57c8-482b-bc10-3d8e7e4777c5 req-f76251d5-1ee4-49f2-bc5f-f63c4c8dfaed tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=618a73da-df70-4028-8443-ff8667721881 HTTP/1.1" status: 200  len: 943 time: 0.9807630
May 31 16:21:45.296217 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-65e25d73-1d8e-46db-a79d-af6beb622d74 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:45.317277 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port ec5c850b-3c95-4ae6-869b-87be2055c0aa completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:21:45.329305 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port ec5c850b-3c95-4ae6-869b-87be2055c0aa triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:45.330059 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:45.338693 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-16c0139a-b448-49b3-bf07-f3c0300db3fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:45.340200 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-16c0139a-b448-49b3-bf07-f3c0300db3fe service neutron] 10.222.0.63 "GET /v2.0/subnets?id=68c4d303-4299-4977-888e-57c80b8530cc HTTP/1.1" status: 200  len: 854 time: 0.2667036
May 31 16:21:45.349293 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a48f1f2b-57c8-482b-bc10-3d8e7e4777c5 req-29492dc4-4153-4b9f-a8ad-6ab4e08c1e21 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0991683
May 31 16:21:45.442520 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-0d7f3d2b-8d93-42ef-acfe-768c7f461c68 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=1097eeec-06a4-406d-ab4a-02e0123072d2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0884364
May 31 16:21:45.443572 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Pushing event updated for resources: {'Port': ['ID=e9ece5ff-8846-4f48-8d10-1021be81f9e5,revision_number=2']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:45.449824 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.238s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:45.511466 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:21:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-30ba9f1e-a587-4c25-9e4b-66d5769b7a5e x-openstack-request-id: req-30ba9f1e-a587-4c25-9e4b-66d5769b7a5e {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:21:45.512382 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "618a73da-df70-4028-8443-ff8667721881", "tag": "a94146eb-55eb-45df-b975-f2732f9d455d", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:21:45.512873 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-30ba9f1e-a587-4c25-9e4b-66d5769b7a5e {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:21:45.513517 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '618a73da-df70-4028-8443-ff8667721881', 'tag': 'a94146eb-55eb-45df-b975-f2732f9d455d', 'status': 'completed', 'code': 200}
May 31 16:21:45.649626 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:45.664372 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-65e25d73-1d8e-46db-a79d-af6beb622d74 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=b39a9128569f4cffa7ce36ae4b05bf2c&name=default HTTP/1.1" status: 200  len: 2979 time: 1.7917352
May 31 16:21:45.665104 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59938) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:45.719154 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port ec5c850b-3c95-4ae6-869b-87be2055c0aa, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=ec5c850b-3c95-4ae6-869b-87be2055c0aa,segment=NetworkSegment(44700c9f-b523-4212-86eb-cc7308ee0431),segment_id=44700c9f-b523-4212-86eb-cc7308ee0431)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:21:45.729447 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:45.743818 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-3ffe1939-f5e2-41a9-9101-05472b88f80b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:45.808170 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-ab477caa-127e-4721-a9da-c302271f34b1 service neutron] 10.222.0.63 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3538325
May 31 16:21:45.835134 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:45.839290 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5dc468af-3e88-44cf-88af-931503f25ef1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:45.884690 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5dc468af-3e88-44cf-88af-931503f25ef1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:45.908924 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=ec5c850b-3c95-4ae6-869b-87be2055c0aa,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:45.922714 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:45.975680 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:46.015775 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-b4ebdf2e-c2fe-4963-9179-92cd7cc8126b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:46.085659 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:21:46.105677 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:46.112088 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5dc468af-3e88-44cf-88af-931503f25ef1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:46.115945 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:21:46.142068 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b105eca2-6c0d-40cb-bcb3-d12ef91bbc56 req-e1a936aa-5ccb-45df-8703-98e333c2a78e service neutron] 10.222.0.63 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3056223
May 31 16:21:46.185211 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Pushing event updated for resources: {'Port': ['ID=2f39560e-c0eb-445a-ab3c-55c4c613178f,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:46.190929 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:46.193914 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.046s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:46.211839 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dc468af-3e88-44cf-88af-931503f25ef1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=00412b4b-df7a-4a14-b4ed-947c10a9e1d8,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:46.225876 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-5dc468af-3e88-44cf-88af-931503f25ef1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:46.296957 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5dc468af-3e88-44cf-88af-931503f25ef1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:46.298144 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-5dc468af-3e88-44cf-88af-931503f25ef1 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/00412b4b-df7a-4a14-b4ed-947c10a9e1d8 HTTP/1.1" status: 204  len: 168 time: 0.6268106
May 31 16:21:46.367692 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c2ede30-a25f-4e97-bdd2-556452a4393e req-c59115ad-c099-4cdc-a03a-73217f1c770d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:46.369185 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5c2ede30-a25f-4e97-bdd2-556452a4393e req-c59115ad-c099-4cdc-a03a-73217f1c770d service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=0eb6e65b3f844417816fb1e5c88a8004&device_id=618a73da-df70-4028-8443-ff8667721881 HTTP/1.1" status: 200  len: 1096 time: 0.1533802
May 31 16:21:46.378256 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4aa59e8-9964-4ddc-a597-3911078b6093 req-0e6e5bfb-1da1-4d9b-a124-9c756ac2508b tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:46.380202 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a4aa59e8-9964-4ddc-a597-3911078b6093 req-0e6e5bfb-1da1-4d9b-a124-9c756ac2508b tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.1230614
May 31 16:21:46.552215 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a4aa59e8-9964-4ddc-a597-3911078b6093 req-b2e829a4-db0d-4014-9889-73acc2285907 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1482463
May 31 16:21:46.684838 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c2ede30-a25f-4e97-bdd2-556452a4393e req-84cc7267-10bf-4d12-a70f-b360ff2a04f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:46.695717 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5c2ede30-a25f-4e97-bdd2-556452a4393e req-84cc7267-10bf-4d12-a70f-b360ff2a04f5 service neutron] 10.222.0.63 "GET /v2.0/networks?id=1097eeec-06a4-406d-ab4a-02e0123072d2 HTTP/1.1" status: 200  len: 915 time: 0.3051677
May 31 16:21:46.820429 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5c2ede30-a25f-4e97-bdd2-556452a4393e req-6de76750-1051-4f50-9ba6-96dff6b158b2 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=a94146eb-55eb-45df-b975-f2732f9d455d HTTP/1.1" status: 200  len: 217 time: 0.1236010
May 31 16:21:46.959033 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device e9ece5ff-8846-4f48-8d10-1021be81f9e5 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:46.996753 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c2ede30-a25f-4e97-bdd2-556452a4393e req-8c497fea-2408-4e8d-83f6-d1c387b6da28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:46.998531 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5c2ede30-a25f-4e97-bdd2-556452a4393e req-8c497fea-2408-4e8d-83f6-d1c387b6da28 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=68c4d303-4299-4977-888e-57c80b8530cc HTTP/1.1" status: 200  len: 854 time: 0.1051595
May 31 16:21:47.091239 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5c2ede30-a25f-4e97-bdd2-556452a4393e req-8ecf82cf-df69-4455-aca8-8a9162e46b16 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=1097eeec-06a4-406d-ab4a-02e0123072d2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0822229
May 31 16:21:47.098971 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8be2939-b1b5-41e0-ac3a-6aa8d91641ae req-d67ad1f6-bca3-4e8a-8df7-1de4c945f121 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:47.100742 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d8be2939-b1b5-41e0-ac3a-6aa8d91641ae req-d67ad1f6-bca3-4e8a-8df7-1de4c945f121 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=618a73da-df70-4028-8443-ff8667721881 HTTP/1.1" status: 200  len: 943 time: 0.2770872
May 31 16:21:47.107002 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37f8cc6e-d780-46fe-8e59-acd739080bb5 None None] Network ebb8f1cc-6c15-416d-995e-90978c0e9eac requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:21:47.127068 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:47.257099 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d8be2939-b1b5-41e0-ac3a-6aa8d91641ae req-8f4e2f1a-d175-43f4-a4d8-13623d4eee81 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1331201
May 31 16:21:47.435791 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5c2ede30-a25f-4e97-bdd2-556452a4393e req-37153b69-cd99-4204-a668-06c2a2522536 service neutron] 10.222.0.63 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3107209
May 31 16:21:47.473192 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port e9ece5ff-8846-4f48-8d10-1021be81f9e5 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:21:47.495315 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-fe8dd8e0-0e68-4dae-bd17-2041287bf305 None None] Provisioning for port e9ece5ff-8846-4f48-8d10-1021be81f9e5 completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:21:47.503049 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port e9ece5ff-8846-4f48-8d10-1021be81f9e5 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:47.503558 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:47.607119 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-fe8dd8e0-0e68-4dae-bd17-2041287bf305 None None] Provisioning complete for port e9ece5ff-8846-4f48-8d10-1021be81f9e5 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:47.610877 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-fe8dd8e0-0e68-4dae-bd17-2041287bf305 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:47.625286 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-16623797', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16621573'] for router, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:47.672531 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5c2ede30-a25f-4e97-bdd2-556452a4393e req-555b567f-82b9-4429-ab8c-81e1a3434e7d service neutron] 10.222.0.63 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2314088
May 31 16:21:47.837934 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device a94146eb-55eb-45df-b975-f2732f9d455d details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:21:47.955740 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33ab2095-39ac-47ad-af53-df5962617752 req-1db17317-da3e-46c7-a7aa-f8787dcc202e tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:47.957626 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-33ab2095-39ac-47ad-af53-df5962617752 req-1db17317-da3e-46c7-a7aa-f8787dcc202e tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.1706553
May 31 16:21:48.007323 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 59986) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:48.045366 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-33ab2095-39ac-47ad-af53-df5962617752 req-dfdf0954-bd4c-4787-b76b-f5dc5290bbc1 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0796499
May 31 16:21:48.065233 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Router 1d03fb4c-8bb7-46ac-916b-6c44e5689b95 is scheduled to L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e with binding_index 1 {{(pid=91763) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 31 16:21:48.077500 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-fe8dd8e0-0e68-4dae-bd17-2041287bf305 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:48.216057 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:48.324737 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-fe8dd8e0-0e68-4dae-bd17-2041287bf305 None None] For port e9ece5ff-8846-4f48-8d10-1021be81f9e5, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=e9ece5ff-8846-4f48-8d10-1021be81f9e5,segment=NetworkSegment(b72084f1-c698-4897-bb6d-f45dadd02fbd),segment_id=b72084f1-c698-4897-bb6d-f45dadd02fbd)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:21:48.339449 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-fe8dd8e0-0e68-4dae-bd17-2041287bf305 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:48.345457 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-3ffe1939-f5e2-41a9-9101-05472b88f80b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:48.452675 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-964642837-network', 'tenant_id': 'a71056b86c954a28a332aee562d539a4'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:48.460732 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port a94146eb-55eb-45df-b975-f2732f9d455d, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=a94146eb-55eb-45df-b975-f2732f9d455d,segment=NetworkSegment(016e9daa-b906-4ec8-978d-cb58fbcd78da),segment_id=016e9daa-b906-4ec8-978d-cb58fbcd78da)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:21:48.480605 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:48.487257 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Usage tracker for resource:network and tenant:a71056b86c954a28a332aee562d539a4 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:48.494226 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:48.505677 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:48.523999 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': 'a94146eb-55eb-45df-b975-f2732f9d455d', 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2', 'port_id': 'a94146eb-55eb-45df-b975-f2732f9d455d', 'mac_address': 'fa:16:3e:0a:15:e3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 838, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '68c4d303-4299-4977-888e-57c80b8530cc', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:21:48.534108 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:21:48.538843 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Made reservation on behalf of a71056b86c954a28a332aee562d539a4 for: {'network': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:21:48.541263 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-639279'] for network, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:48.555066 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] Sync routers for ids ['1d03fb4c-8bb7-46ac-916b-6c44e5689b95'] in dv-cinder-793814-1-iscsi {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:21:48.562729 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:48.575458 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e6044f0-aa0c-4132-94c2-d26d55a9385b req-8d9443f3-1c3b-49c9-b482-ea22bf1f1c5a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:48.577487 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4e6044f0-aa0c-4132-94c2-d26d55a9385b req-8d9443f3-1c3b-49c9-b482-ea22bf1f1c5a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=618a73da-df70-4028-8443-ff8667721881 HTTP/1.1" status: 200  len: 943 time: 0.1314406
May 31 16:21:48.584508 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] Routers {'1d03fb4c-8bb7-46ac-916b-6c44e5689b95'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:21:48.586722 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.db.api [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=91765) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}}
May 31 16:21:48.587146 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_db.api [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}}
May 31 16:21:48.587332 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426fc6550>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:21:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['1d03fb4c-8bb7-46ac-916b-6c44e5689b95'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:48.594588 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:48.599718 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe8dd8e0-0e68-4dae-bd17-2041287bf305 None None] Pushing event updated for resources: {'Port': ['ID=e9ece5ff-8846-4f48-8d10-1021be81f9e5,revision_number=3']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:48.599948 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Notify callbacks [] for router, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:48.603727 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201  len: 925 time: 5.5883434
May 31 16:21:48.611143 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60002) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:48.615005 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Usage tracker for resource:security_group_rule and tenant:a71056b86c954a28a332aee562d539a4 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:48.627627 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-fe8dd8e0-0e68-4dae-bd17-2041287bf305 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.282s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:48.632867 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-e6887866-4d62-49f6-aca8-a82f573db097 None None] Provisioning complete for port e9ece5ff-8846-4f48-8d10-1021be81f9e5 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:48.633341 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-e6887866-4d62-49f6-aca8-a82f573db097 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:48.683774 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:48.686258 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:48.709891 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:48.711835 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4e6044f0-aa0c-4132-94c2-d26d55a9385b req-9a9f95b4-8a02-49f1-bce8-cbbe2ca899f2 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1210763
May 31 16:21:48.721056 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a94146eb-55eb-45df-b975-f2732f9d455d {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:21:48.780419 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port a94146eb-55eb-45df-b975-f2732f9d455d, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=a94146eb-55eb-45df-b975-f2732f9d455d,segment=NetworkSegment(016e9daa-b906-4ec8-978d-cb58fbcd78da),segment_id=016e9daa-b906-4ec8-978d-cb58fbcd78da)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:21:48.787842 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:48.796098 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:48.915911 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=a94146eb-55eb-45df-b975-f2732f9d455d,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:48.916697 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] Set router 1d03fb4c-8bb7-46ac-916b-6c44e5689b95 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:21:48.925510 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:49.085868 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:49.149137 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:49.172451 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:21:49.177215 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:49.183298 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['a94146eb-55eb-45df-b975-f2732f9d455d'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:21:49.242067 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device ec5c850b-3c95-4ae6-869b-87be2055c0aa up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:49.248560 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 812}  {{(pid=91763) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 31 16:21:49.269123 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:49.269916 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.segments_db [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Added segment f3efb8ab-0842-4631-8de8-e4ee3a4578ac of type vlan for network 36ac85f0-2d37-4c8f-a77a-0f63488bbf39
May 31 16:21:49.312431 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732784079930'] for network, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:49.314334 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d44b5e-145c-4489-93fc-03f54a133ab0 req-81374401-c3b3-4cea-99cb-a7e04194973c tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:49.320260 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426fc6550>, [{'id': '1d03fb4c-8bb7-46ac-916b-6c44e5689b95', 'name': 'tempest-TestMinimumBasicScenario-348591781-router', 'tenant_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.70'}], 'enable_snat': True}, 'gw_port_id': '2f39560e-c0eb-445a-ab3c-55c4c613178f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:43Z', 'updated_at': '2021-05-31T16:21:46Z', 'revision_number': 3, 'project_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'gw_port': {'id': '2f39560e-c0eb-445a-ab3c-55c4c613178f', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:7a:dd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1d03fb4c-8bb7-46ac-916b-6c44e5689b95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:44Z', 'updated_at': '2021-05-31T16:21:45Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:49.321378 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-25d44b5e-145c-4489-93fc-03f54a133ab0 req-81374401-c3b3-4cea-99cb-a7e04194973c tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.1546383
May 31 16:21:49.331185 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] Checking router: 1d03fb4c-8bb7-46ac-916b-6c44e5689b95 for host: dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:21:49.331597 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] Updating router 1d03fb4c-8bb7-46ac-916b-6c44e5689b95 port 2f39560e-c0eb-445a-ab3c-55c4c613178f binding host dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 31 16:21:49.393457 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-25d44b5e-145c-4489-93fc-03f54a133ab0 req-faa5a3ab-8e76-4ae6-b885-423330523fbd tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0688987
May 31 16:21:49.411636 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c45f3d2-9acf-4288-ad17-8bd9aea4cfb3,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:49.417336 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366'] for network, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:49.420572 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.244s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:49.423855 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:49.424461 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:49.429277 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-10e3a15e-ab08-48da-81a1-81548e1b9214 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:49.470037 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:49.500010 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port ec5c850b-3c95-4ae6-869b-87be2055c0aa triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:49.500628 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:49.644991 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:49.780359 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 60028) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:49.780963 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201  len: 897 time: 1.7720876
May 31 16:21:49.791570 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-87ab88ad-ecac-4c3d-9b6f-7d8808242b9d admin admin] Request body: {'subnet': {'network_id': '36ac85f0-2d37-4c8f-a77a-0f63488bbf39', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-964642837-subnet', 'tenant_id': 'a71056b86c954a28a332aee562d539a4', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:49.796334 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Pushing event updated for resources: {'Network': ['ID=36ac85f0-2d37-4c8f-a77a-0f63488bbf39,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:49.801706 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.372s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:49.813989 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-87ab88ad-ecac-4c3d-9b6f-7d8808242b9d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:49.825133 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Network 36ac85f0-2d37-4c8f-a77a-0f63488bbf39 details requested by agent ovs-agent-dv-cinder-793814-1-iscsi with host dv-cinder-793814-1-iscsi {{(pid=91765) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 31 16:21:49.827990 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-87ab88ad-ecac-4c3d-9b6f-7d8808242b9d admin admin] Usage tracker for resource:subnet and tenant:a71056b86c954a28a332aee562d539a4 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:49.837517 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-87ab88ad-ecac-4c3d-9b6f-7d8808242b9d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:49.857238 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-87ab88ad-ecac-4c3d-9b6f-7d8808242b9d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:49.891675 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-87ab88ad-ecac-4c3d-9b6f-7d8808242b9d admin admin] Made reservation on behalf of a71056b86c954a28a332aee562d539a4 for: {'subnet': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:21:49.897982 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-87ab88ad-ecac-4c3d-9b6f-7d8808242b9d admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14793668'] for subnet, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:50.158869 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:50.188072 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] Notify callbacks [] for port, precommit_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:50.204422 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.provisioning_blocks [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] Transition to ACTIVE for port object 2f39560e-c0eb-445a-ab3c-55c4c613178f will not be triggered until provisioned by entity L2. {{(pid=91766) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:50.212044 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device e9ece5ff-8846-4f48-8d10-1021be81f9e5 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:50.226518 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:50.231688 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:50.420172 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port e9ece5ff-8846-4f48-8d10-1021be81f9e5 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:50.420810 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:50.459593 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] Attempting to bind port 2f39560e-c0eb-445a-ab3c-55c4c613178f on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:21:50.460438 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] Attempting to bind port 2f39560e-c0eb-445a-ab3c-55c4c613178f by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}] {{(pid=91766) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:21:50.461341 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] Attempting to bind port 2f39560e-c0eb-445a-ab3c-55c4c613178f on network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:21:50.479272 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Allocated IP 172.20.0.1 (ebb8f1cc-6c15-416d-995e-90978c0e9eac/19349b15-7a29-4559-912d-95f2c3f6c489/1da6e62c-8254-4b52-9755-bf21e7ceacdf) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:21:50.497883 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 21, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:21:50.505219 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] Checking segment: {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91766) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:50.510712 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:50.511476 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] Bound using segment: {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'} {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:21:50.512675 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] Bound port: 2f39560e-c0eb-445a-ab3c-55c4c613178f, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}}] {{(pid=91766) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:21:50.513470 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:50.607229 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68eb08f8-b7c3-481a-9f97-d85820486f58 None None] Pushing event updated for resources: {'Port': ['ID=2f39560e-c0eb-445a-ab3c-55c4c613178f,revision_number=2']} {{(pid=91766) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:50.624636 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-68eb08f8-b7c3-481a-9f97-d85820486f58 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.393s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:50.629858 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef12a9d-76e4-4605-8ae1-51bbe587d6d4 req-dc3bca1a-bbb8-4448-96e0-230f49194332 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:50.633750 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4ef12a9d-76e4-4605-8ae1-51bbe587d6d4 req-dc3bca1a-bbb8-4448-96e0-230f49194332 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=618a73da-df70-4028-8443-ff8667721881 HTTP/1.1" status: 200  len: 944 time: 0.5953131
May 31 16:21:50.693270 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:50.716788 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.provisioning_blocks [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Transition to ACTIVE for port object 1da6e62c-8254-4b52-9755-bf21e7ceacdf will not be triggered until provisioned by entity DHCP. {{(pid=91763) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:50.746820 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:50.752365 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:50.759018 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4ef12a9d-76e4-4605-8ae1-51bbe587d6d4 req-ceac62dc-ddc9-4864-81b1-95d056287077 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0605836
May 31 16:21:50.774410 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.db [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] For port 2f39560e-c0eb-445a-ab3c-55c4c613178f, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91766) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:21:50.788249 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.db [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] For port 2f39560e-c0eb-445a-ab3c-55c4c613178f, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=2f39560e-c0eb-445a-ab3c-55c4c613178f,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91766) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:21:50.811538 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:50.819746 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:50.845278 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Pushing event updated for resources: {'Port': ['ID=1da6e62c-8254-4b52-9755-bf21e7ceacdf,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:50.856124 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:50.873815 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Network ebb8f1cc-6c15-416d-995e-90978c0e9eac is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:21:50.875230 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:50.889142 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:21:50.969349 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] Routers {'1d03fb4c-8bb7-46ac-916b-6c44e5689b95'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:21:50.970280 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426fc6550>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:21:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['1d03fb4c-8bb7-46ac-916b-6c44e5689b95'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:51.008543 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-87ab88ad-ecac-4c3d-9b6f-7d8808242b9d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-14907233', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14793682'] for subnet, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:51.016151 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:51.058481 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4542903-8daf-473c-9f47-b28913fe0598 req-31421bc7-5dde-4275-86d3-645b28d942e3 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:51.066398 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e4542903-8daf-473c-9f47-b28913fe0598 req-31421bc7-5dde-4275-86d3-645b28d942e3 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.2123764
May 31 16:21:51.117513 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-16627828'] for router_interface, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:51.203685 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87ab88ad-ecac-4c3d-9b6f-7d8808242b9d admin admin] Pushing event updated for resources: {'Subnet': ['ID=bd981711-0dad-484e-a5a1-1e310d10df84,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:51.216342 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-87ab88ad-ecac-4c3d-9b6f-7d8808242b9d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.200s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:51.224222 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] Set router 1d03fb4c-8bb7-46ac-916b-6c44e5689b95 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:21:51.236450 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e4542903-8daf-473c-9f47-b28913fe0598 req-9d05fb2c-b79d-4e95-9552-8d6f1689af9e tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1687424
May 31 16:21:51.261995 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87ab88ad-ecac-4c3d-9b6f-7d8808242b9d admin admin] Checking segment: {'id': 'f3efb8ab-0842-4631-8de8-e4ee3a4578ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 812, 'network_id': '36ac85f0-2d37-4c8f-a77a-0f63488bbf39'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:51.270323 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87ab88ad-ecac-4c3d-9b6f-7d8808242b9d admin admin] Network hostable DHCP agents. Network: 36ac85f0-2d37-4c8f-a77a-0f63488bbf39, hostable agents: ['5c9859e8-5965-4c86-8b2b-8fab235cbf66'], hosted agents: [] {{(pid=91764) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 31 16:21:51.296239 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87ab88ad-ecac-4c3d-9b6f-7d8808242b9d admin admin] Network 36ac85f0-2d37-4c8f-a77a-0f63488bbf39 is scheduled to be hosted by DHCP agent 5c9859e8-5965-4c86-8b2b-8fab235cbf66 with binding_index 1 {{(pid=91764) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 31 16:21:51.313678 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-87ab88ad-ecac-4c3d-9b6f-7d8808242b9d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793814-1-iscsi, 36ac85f0-2d37-4c8f-a77a-0f63488bbf39) {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:51.322498 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-c0c0cf53-cb40-4d55-ae36-07d10e415c8c None None] Provisioning for port 1da6e62c-8254-4b52-9755-bf21e7ceacdf completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:21:51.330802 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68eb08f8-b7c3-481a-9f97-d85820486f58 None None] Pushing event updated for resources: {'Port': ['ID=2f39560e-c0eb-445a-ab3c-55c4c613178f,revision_number=3']} {{(pid=91766) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:51.333288 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-c0c0cf53-cb40-4d55-ae36-07d10e415c8c None None] Provisioning complete for port 1da6e62c-8254-4b52-9755-bf21e7ceacdf triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:51.333580 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-c0c0cf53-cb40-4d55-ae36-07d10e415c8c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:51.336843 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-87ab88ad-ecac-4c3d-9b6f-7d8808242b9d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:51.338426 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-87ab88ad-ecac-4c3d-9b6f-7d8808242b9d admin admin] Notify callbacks [] for subnet, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:51.340282 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-68eb08f8-b7c3-481a-9f97-d85820486f58 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.521s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:51.401299 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-87ab88ad-ecac-4c3d-9b6f-7d8808242b9d admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 861 time: 1.6112063
May 31 16:21:51.401513 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f87149b-c446-491d-859d-380239e3bd77 None None] Network 36ac85f0-2d37-4c8f-a77a-0f63488bbf39 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:21:51.406663 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:51.422625 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-c0c0cf53-cb40-4d55-ae36-07d10e415c8c None None] Port 1da6e62c-8254-4b52-9755-bf21e7ceacdf cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:21:51.651397 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd000da2-1942-4e17-acaa-08f5e31196b3 None None] Network 36ac85f0-2d37-4c8f-a77a-0f63488bbf39 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:21:51.665563 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426fc6550>, [{'id': '1d03fb4c-8bb7-46ac-916b-6c44e5689b95', 'name': 'tempest-TestMinimumBasicScenario-348591781-router', 'tenant_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.70'}], 'enable_snat': True}, 'gw_port_id': '2f39560e-c0eb-445a-ab3c-55c4c613178f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:43Z', 'updated_at': '2021-05-31T16:21:46Z', 'revision_number': 3, 'project_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'gw_port': {'id': '2f39560e-c0eb-445a-ab3c-55c4c613178f', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:7a:dd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1d03fb4c-8bb7-46ac-916b-6c44e5689b95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:44Z', 'updated_at': '2021-05-31T16:21:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:51.671880 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b86aef61-8937-4d95-a1e3-dbf4cdc3f295 None None] The sync data for ids ['1d03fb4c-8bb7-46ac-916b-6c44e5689b95'] in dv-cinder-793814-1-iscsi is: [{'id': '1d03fb4c-8bb7-46ac-916b-6c44e5689b95', 'name': 'tempest-TestMinimumBasicScenario-348591781-router', 'tenant_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.70'}], 'enable_snat': True}, 'gw_port_id': '2f39560e-c0eb-445a-ab3c-55c4c613178f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:43Z', 'updated_at': '2021-05-31T16:21:46Z', 'revision_number': 3, 'project_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'gw_port': {'id': '2f39560e-c0eb-445a-ab3c-55c4c613178f', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:7a:dd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1d03fb4c-8bb7-46ac-916b-6c44e5689b95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:44Z', 'updated_at': '2021-05-31T16:21:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}] {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:21:51.901062 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device a94146eb-55eb-45df-b975-f2732f9d455d up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:51.928285 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Notify callbacks [] for port, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:51.943471 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14337082'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:52.081719 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:52.120559 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning for port a94146eb-55eb-45df-b975-f2732f9d455d completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:21:52.127807 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port a94146eb-55eb-45df-b975-f2732f9d455d triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:52.128236 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:52.187486 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-16310860', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-16627929'] for router_interface, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:52.289870 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Pushing event updated for resources: {'Port': ['ID=1da6e62c-8254-4b52-9755-bf21e7ceacdf,revision_number=2']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:52.296162 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:52.388895 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8fba1d5-521b-4079-b6c3-ed74367b8c89 req-85100119-0950-4fdc-b7c8-3ba89b2cbbd2 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:52.406192 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:52.418421 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e8fba1d5-521b-4079-b6c3-ed74367b8c89 req-85100119-0950-4fdc-b7c8-3ba89b2cbbd2 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=618a73da-df70-4028-8443-ff8667721881 HTTP/1.1" status: 200  len: 944 time: 0.4121878
May 31 16:21:52.430048 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 2f39560e-c0eb-445a-ab3c-55c4c613178f up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:52.506239 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Network ebb8f1cc-6c15-416d-995e-90978c0e9eac is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:21:52.510160 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:52.583742 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '618a73da-df70-4028-8443-ff8667721881', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a94146eb-55eb-45df-b975-f2732f9d455d'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:21:52.592637 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-24b9d6c9-66a3-46fe-9424-6b1b924e7a8a" -d '{"events": [{"server_uuid": "618a73da-df70-4028-8443-ff8667721881", "name": "network-vif-plugged", "status": "completed", "tag": "a94146eb-55eb-45df-b975-f2732f9d455d"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:21:52.648564 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port a94146eb-55eb-45df-b975-f2732f9d455d, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=a94146eb-55eb-45df-b975-f2732f9d455d,segment=NetworkSegment(016e9daa-b906-4ec8-978d-cb58fbcd78da),segment_id=016e9daa-b906-4ec8-978d-cb58fbcd78da)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:21:52.671186 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e8fba1d5-521b-4079-b6c3-ed74367b8c89 req-98aae0a8-1440-40d7-b556-2bd618072c53 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2507563
May 31 16:21:52.683324 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:52.707607 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:52.921202 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 60078) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:52.942958 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1352686807-network', 'tenant_id': '22c9829f838a4f958e9db08e72c27f5b'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:52.960089 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:52.982204 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Usage tracker for resource:network and tenant:22c9829f838a4f958e9db08e72c27f5b is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:52.992417 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:21:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c5b9f8be-a073-495f-a490-571f82a3a303 x-openstack-request-id: req-c5b9f8be-a073-495f-a490-571f82a3a303 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:21:52.992709 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "618a73da-df70-4028-8443-ff8667721881", "name": "network-vif-plugged", "status": "completed", "tag": "a94146eb-55eb-45df-b975-f2732f9d455d", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:21:52.994149 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-c5b9f8be-a073-495f-a490-571f82a3a303 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:21:52.995212 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '618a73da-df70-4028-8443-ff8667721881', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a94146eb-55eb-45df-b975-f2732f9d455d', 'code': 200}
May 31 16:21:53.003165 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=a94146eb-55eb-45df-b975-f2732f9d455d,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:53.012127 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.305s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:53.017897 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:53.044911 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:53.047936 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-b75fa26e-86b9-4467-adfd-e5774ad6ab9b None None] Provisioning complete for port 1da6e62c-8254-4b52-9755-bf21e7ceacdf triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:53.048329 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-b75fa26e-86b9-4467-adfd-e5774ad6ab9b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:53.090857 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Made reservation on behalf of 22c9829f838a4f958e9db08e72c27f5b for: {'network': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:21:53.097067 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-639279'] for network, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:53.137235 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9841ab0b-65b8-49b5-846b-63b69ead195e req-e0dd99d1-4e31-4d88-a929-c9d660fb0e73 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:53.154326 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9841ab0b-65b8-49b5-846b-63b69ead195e req-e0dd99d1-4e31-4d88-a929-c9d660fb0e73 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.4073436
May 31 16:21:53.161984 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Router 1d03fb4c-8bb7-46ac-916b-6c44e5689b95 has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91763) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:21:53.193256 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:53.225977 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-b75fa26e-86b9-4467-adfd-e5774ad6ab9b None None] Port 1da6e62c-8254-4b52-9755-bf21e7ceacdf cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:21:53.226251 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:53.230808 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port 2f39560e-c0eb-445a-ab3c-55c4c613178f completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:21:53.240976 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 2f39560e-c0eb-445a-ab3c-55c4c613178f triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:53.241658 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:53.287942 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Usage tracker for resource:security_group_rule and tenant:22c9829f838a4f958e9db08e72c27f5b is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:53.299223 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:53.306031 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9841ab0b-65b8-49b5-846b-63b69ead195e req-3c00be02-b37a-42e2-aa87-aabd407e9922 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1479390
May 31 16:21:53.321181 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:53.396373 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-915d84bc-80bf-4524-875c-3fdbdc30815d req-5b12e9a0-070a-4e7f-9a3f-16b87ad72cc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:53.398092 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-915d84bc-80bf-4524-875c-3fdbdc30815d req-5b12e9a0-070a-4e7f-9a3f-16b87ad72cc1 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=618a73da-df70-4028-8443-ff8667721881 HTTP/1.1" status: 200  len: 1098 time: 0.1684442
May 31 16:21:53.495767 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:21:53.497647 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:53.518625 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] 10.222.0.43 "PUT /v2.0/routers/1d03fb4c-8bb7-46ac-916b-6c44e5689b95/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.9063263
May 31 16:21:53.520757 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:53.527938 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-8cda419d-8e33-4fe1-87fb-2115236f1377 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:53.568756 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eee8665f-8258-4576-850a-87678e1dc7d8,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:53.587112 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:53.594390 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:53.612501 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-915d84bc-80bf-4524-875c-3fdbdc30815d req-b26c9848-a31a-4b41-8776-ee6bbf2a8f64 service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1976914
May 31 16:21:53.627125 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 840}  {{(pid=91764) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 31 16:21:53.632684 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port 2f39560e-c0eb-445a-ab3c-55c4c613178f, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=2f39560e-c0eb-445a-ab3c-55c4c613178f,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:21:53.641285 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:53.643588 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:53.654753 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:53.655363 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.db.segments_db [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Added segment 6d889a88-e991-48c6-9a07-d075c97567a7 of type vlan for network e75c3dc0-4d36-48bc-9599-ab80099734d6
May 31 16:21:53.695376 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732784079930'] for network, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:53.720280 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=2f39560e-c0eb-445a-ab3c-55c4c613178f,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:53.724114 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:53.740371 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366'] for network, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:53.741957 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:53.742619 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:53.748121 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-efdb2404-0da8-4088-bb51-2c860b27c06c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:54.112803 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201  len: 898 time: 1.1867354
May 31 16:21:54.113819 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60096) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:54.122381 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Pushing event updated for resources: {'Network': ['ID=e75c3dc0-4d36-48bc-9599-ab80099734d6,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:54.126212 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-5816e470-fda3-4086-a1df-4788ffaf2827 admin admin] Request body: {'subnet': {'network_id': 'e75c3dc0-4d36-48bc-9599-ab80099734d6', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1352686807-subnet', 'tenant_id': '22c9829f838a4f958e9db08e72c27f5b', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:21:54.132012 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.384s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:54.136441 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-5816e470-fda3-4086-a1df-4788ffaf2827 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:21:54.142425 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-5816e470-fda3-4086-a1df-4788ffaf2827 admin admin] Usage tracker for resource:subnet and tenant:22c9829f838a4f958e9db08e72c27f5b is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:21:54.144044 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Network e75c3dc0-4d36-48bc-9599-ab80099734d6 details requested by agent ovs-agent-dv-cinder-793814-1-iscsi with host dv-cinder-793814-1-iscsi {{(pid=91765) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 31 16:21:54.151097 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-5816e470-fda3-4086-a1df-4788ffaf2827 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:21:54.181720 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-5816e470-fda3-4086-a1df-4788ffaf2827 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:21:54.223618 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a4449e3-8f2e-411d-bcc7-fde479bc874e req-f11f6a14-3575-4d76-b7a6-65f3a320d66d tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:54.226470 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9a4449e3-8f2e-411d-bcc7-fde479bc874e req-f11f6a14-3575-4d76-b7a6-65f3a320d66d tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=618a73da-df70-4028-8443-ff8667721881 HTTP/1.1" status: 200  len: 945 time: 0.3685768
May 31 16:21:54.234954 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5816e470-fda3-4086-a1df-4788ffaf2827 admin admin] Made reservation on behalf of 22c9829f838a4f958e9db08e72c27f5b for: {'subnet': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:21:54.239606 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5816e470-fda3-4086-a1df-4788ffaf2827 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-13992668'] for subnet, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:54.358520 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9a4449e3-8f2e-411d-bcc7-fde479bc874e req-faafaeec-038d-4383-8b98-cfd5f23a66a6 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1210935
May 31 16:21:54.367963 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 2f39560e-c0eb-445a-ab3c-55c4c613178f up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:21:54.700790 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22172dd0-5e3f-417a-8ec4-62e6be32c1b8 req-a762cda4-bea9-4f47-8f97-91928005e22b tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:54.713718 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-22172dd0-5e3f-417a-8ec4-62e6be32c1b8 req-a762cda4-bea9-4f47-8f97-91928005e22b tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.1622093
May 31 16:21:54.855962 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 2f39560e-c0eb-445a-ab3c-55c4c613178f triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:21:54.856536 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-22172dd0-5e3f-417a-8ec4-62e6be32c1b8 req-c5f3cca5-e1c1-467b-9ad7-5647ea58d7c0 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1413114
May 31 16:21:54.856637 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:55.029820 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] Sync routers for ids ['1d03fb4c-8bb7-46ac-916b-6c44e5689b95'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:21:55.138916 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] Routers {'1d03fb4c-8bb7-46ac-916b-6c44e5689b95'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:21:55.140031 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426213880>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:21:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['1d03fb4c-8bb7-46ac-916b-6c44e5689b95'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:55.162552 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5816e470-fda3-4086-a1df-4788ffaf2827 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-14336643', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-13992650'] for subnet, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:55.167277 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:55.461614 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5816e470-fda3-4086-a1df-4788ffaf2827 admin admin] Pushing event updated for resources: {'Subnet': ['ID=fafc663d-0e06-47c9-b069-a52720c685ac,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:55.476992 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-5816e470-fda3-4086-a1df-4788ffaf2827 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.308s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:55.496783 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5816e470-fda3-4086-a1df-4788ffaf2827 admin admin] Checking segment: {'id': '6d889a88-e991-48c6-9a07-d075c97567a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': 'e75c3dc0-4d36-48bc-9599-ab80099734d6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91763) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:55.497438 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5816e470-fda3-4086-a1df-4788ffaf2827 admin admin] Network hostable DHCP agents. Network: e75c3dc0-4d36-48bc-9599-ab80099734d6, hostable agents: ['5c9859e8-5965-4c86-8b2b-8fab235cbf66'], hosted agents: [] {{(pid=91763) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 31 16:21:55.568751 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5816e470-fda3-4086-a1df-4788ffaf2827 admin admin] Network e75c3dc0-4d36-48bc-9599-ab80099734d6 is scheduled to be hosted by DHCP agent 5c9859e8-5965-4c86-8b2b-8fab235cbf66 with binding_index 1 {{(pid=91763) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 31 16:21:55.604324 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-5816e470-fda3-4086-a1df-4788ffaf2827 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793814-1-iscsi, e75c3dc0-4d36-48bc-9599-ab80099734d6) {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:21:55.634263 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5816e470-fda3-4086-a1df-4788ffaf2827 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:55.642146 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5816e470-fda3-4086-a1df-4788ffaf2827 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:55.665136 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-8be34ab6-7169-4ca4-b479-c82b57032885 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1973905508&fields=id&tenant_id=092115f69b8e401b8c334f7b3e797aad HTTP/1.1" status: 200  len: 267 time: 0.2316101
May 31 16:21:55.733869 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3769f69c-a5a0-49d7-91c5-cef74d33f357 None None] Network e75c3dc0-4d36-48bc-9599-ab80099734d6 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:21:55.743759 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-5816e470-fda3-4086-a1df-4788ffaf2827 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 862 time: 1.6273441
May 31 16:21:56.029745 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] Set router 1d03fb4c-8bb7-46ac-916b-6c44e5689b95 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:21:56.108138 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60158) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:56.137694 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-d45aeba3-5c80-419c-b2ef-c4c981f3a8b9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:56.146522 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-d45aeba3-5c80-419c-b2ef-c4c981f3a8b9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/networks?id=5b237728-dc31-4203-bbac-66ce3db1593a HTTP/1.1" status: 200  len: 812 time: 0.4691634
May 31 16:21:56.156964 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82a0da48-714d-48e2-b3b6-5d0fd988f436 req-5198fb09-5a73-47c6-b531-00104a1916c7 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:56.165486 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-82a0da48-714d-48e2-b3b6-5d0fd988f436 req-5198fb09-5a73-47c6-b531-00104a1916c7 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=618a73da-df70-4028-8443-ff8667721881 HTTP/1.1" status: 200  len: 945 time: 0.3898335
May 31 16:21:56.216784 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-71147f1f-9e62-4a6b-a4d4-7b9c6cad9198 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/quotas/092115f69b8e401b8c334f7b3e797aad HTTP/1.1" status: 200  len: 375 time: 0.0688837
May 31 16:21:56.286189 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_v2 [None req-3b07ebf0-cc3c-46d5-96e4-a4ad2e420e38 admin admin] Deleting subnet bd981711-0dad-484e-a5a1-1e310d10df84 {{(pid=91763) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 31 16:21:56.295496 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3b07ebf0-cc3c-46d5-96e4-a4ad2e420e38 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:56.299189 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-82a0da48-714d-48e2-b3b6-5d0fd988f436 req-a70aa347-6b71-45fa-996e-345a3e0f89e2 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1324084
May 31 16:21:56.408891 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-26d37ffe-03b5-48d5-83c8-035def53a021 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=092115f69b8e401b8c334f7b3e797aad&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1901178
May 31 16:21:56.422057 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3b07ebf0-cc3c-46d5-96e4-a4ad2e420e38 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-15104879'] for subnet, precommit_delete_associations {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:56.449946 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70b6e826-1355-4cf0-971b-609a6ec6bcb6 None None] Network e75c3dc0-4d36-48bc-9599-ab80099734d6 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:21:56.552972 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3b07ebf0-cc3c-46d5-96e4-a4ad2e420e38 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-975336'] for subnet, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:56.726131 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-83b1bcb4-19e6-4a41-929b-46ae33b9e250 service neutron] 10.222.0.43 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3162520
May 31 16:21:57.022458 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426213880>, [{'id': '1d03fb4c-8bb7-46ac-916b-6c44e5689b95', 'name': 'tempest-TestMinimumBasicScenario-348591781-router', 'tenant_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.70'}], 'enable_snat': True}, 'gw_port_id': '2f39560e-c0eb-445a-ab3c-55c4c613178f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:43Z', 'updated_at': '2021-05-31T16:21:51Z', 'revision_number': 4, 'project_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'gw_port': {'id': '2f39560e-c0eb-445a-ab3c-55c4c613178f', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:7a:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d03fb4c-8bb7-46ac-916b-6c44e5689b95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:44Z', 'updated_at': '2021-05-31T16:21:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '1da6e62c-8254-4b52-9755-bf21e7ceacdf', 'name': '', 'network_id': 'ebb8f1cc-6c15-416d-995e-90978c0e9eac', 'tenant_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'mac_address': 'fa:16:3e:ed:92:96', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1d03fb4c-8bb7-46ac-916b-6c44e5689b95', 'device_owner': 'network:router_interface', 'standard_attr_id': 354, 'fixed_ips': [{'subnet_id': '19349b15-7a29-4559-912d-95f2c3f6c489', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:50Z', 'updated_at': '2021-05-31T16:21:51Z', 'revision_number': 2, 'project_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'subnets': [{'id': '19349b15-7a29-4559-912d-95f2c3f6c489', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:57.027593 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] Checking router: 1d03fb4c-8bb7-46ac-916b-6c44e5689b95 for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:21:57.027994 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] Updating router 1d03fb4c-8bb7-46ac-916b-6c44e5689b95 port 1da6e62c-8254-4b52-9755-bf21e7ceacdf binding host dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 31 16:21:57.034297 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-bf41533c-e146-43f7-9905-1e7df0966005 service neutron] 10.222.0.43 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3071804
May 31 16:21:57.132955 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3b07ebf0-cc3c-46d5-96e4-a4ad2e420e38 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-978269', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14336704', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-13992643'] for subnet, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:57.138495 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:57.212394 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b07ebf0-cc3c-46d5-96e4-a4ad2e420e38 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=bd981711-0dad-484e-a5a1-1e310d10df84,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:57.213594 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:57.221882 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3b07ebf0-cc3c-46d5-96e4-a4ad2e420e38 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:57.226513 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b07ebf0-cc3c-46d5-96e4-a4ad2e420e38 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:57.227132 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b07ebf0-cc3c-46d5-96e4-a4ad2e420e38 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:57.227663 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b07ebf0-cc3c-46d5-96e4-a4ad2e420e38 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:57.228309 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b07ebf0-cc3c-46d5-96e4-a4ad2e420e38 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:57.228821 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b07ebf0-cc3c-46d5-96e4-a4ad2e420e38 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:57.229329 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b07ebf0-cc3c-46d5-96e4-a4ad2e420e38 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:57.229919 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b07ebf0-cc3c-46d5-96e4-a4ad2e420e38 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:57.230423 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b07ebf0-cc3c-46d5-96e4-a4ad2e420e38 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:57.230955 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b07ebf0-cc3c-46d5-96e4-a4ad2e420e38 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:57.231472 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b07ebf0-cc3c-46d5-96e4-a4ad2e420e38 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:57.231981 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b07ebf0-cc3c-46d5-96e4-a4ad2e420e38 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:57.232480 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b07ebf0-cc3c-46d5-96e4-a4ad2e420e38 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:21:57.237060 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-3b07ebf0-cc3c-46d5-96e4-a4ad2e420e38 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:57.248725 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-3b07ebf0-cc3c-46d5-96e4-a4ad2e420e38 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/bd981711-0dad-484e-a5a1-1e310d10df84 HTTP/1.1" status: 204  len: 168 time: 1.1368604
May 31 16:21:57.249321 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60174) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:57.345134 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c40d64fe-8c63-4ad1-8ee1-8cb063c184aa req-61c16a9e-e6a5-4675-9fc4-11cb088c7fa1 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:57.348063 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c40d64fe-8c63-4ad1-8ee1-8cb063c184aa req-61c16a9e-e6a5-4675-9fc4-11cb088c7fa1 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.2029080
May 31 16:21:57.461503 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d6e9c03c-506a-42c2-ba37-dab70d097d3d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-525980'] for network, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:57.522904 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c40d64fe-8c63-4ad1-8ee1-8cb063c184aa req-5f315ea9-7b52-4385-9db3-4a624a67139a tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1640882
May 31 16:21:57.750253 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d6e9c03c-506a-42c2-ba37-dab70d097d3d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-988775', 'neutron.services.segments.db._delete_segments_for_network-8732784586204'] for network, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:57.781683 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-d6e9c03c-506a-42c2-ba37-dab70d097d3d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f14255c4eb0>,) {'filters': {'network_id': ['36ac85f0-2d37-4c8f-a77a-0f63488bbf39']}} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:57.827249 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-d6e9c03c-506a-42c2-ba37-dab70d097d3d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f14255c4eb0>, 'f3efb8ab-0842-4631-8de8-e4ee3a4578ac') {'for_net_delete': True} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:57.835095 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-d6e9c03c-506a-42c2-ba37-dab70d097d3d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f14255c4eb0>, 'f3efb8ab-0842-4631-8de8-e4ee3a4578ac') {} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:21:57.879150 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d6e9c03c-506a-42c2-ba37-dab70d097d3d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732784599197', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15104868'] for segment, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:57.914591 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5ba9359-d3c5-49bb-a8ae-c4d6469a345b req-44933dbd-dee2-47cf-9ae6-8ca43dd732fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:57.915091 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d6e9c03c-506a-42c2-ba37-dab70d097d3d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:57.916346 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b5ba9359-d3c5-49bb-a8ae-c4d6469a345b req-44933dbd-dee2-47cf-9ae6-8ca43dd732fa service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 1099 time: 0.2580984
May 31 16:21:57.938453 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d6e9c03c-506a-42c2-ba37-dab70d097d3d admin admin] Releasing vlan 812 on physical network physnet1 to pool {{(pid=91763) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 31 16:21:57.939015 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d6e9c03c-506a-42c2-ba37-dab70d097d3d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14337126'] for segment, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:57.993862 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b5ba9359-d3c5-49bb-a8ae-c4d6469a345b req-a83d70b7-e0ef-4b1a-b91e-6349e13604ba service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0690563
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]: Traceback (most recent call last):
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:     timer()
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:     cb(*args, **kw)
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:     return func(*args, **kwargs)
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:     self._notify()
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:     self.callback(batched_events)
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:     event.method(event)
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:     aggregate_uuid = self.p_client.list_aggregates(
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:     return f(self, *a, **k)
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self._get(url).json()
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self.request(url, 'GET', **kwargs)
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:     base_url = self.get_endpoint(auth, allow=allow,
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 31 16:21:57.999732 dv-cinder-793814-1-iscsi neutron-server[91763]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 31 16:21:58.145980 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3d43a81a-c403-49fd-bc9a-d7d9aae244c8 req-3aa69432-410b-4bc6-920b-662e8d742662 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 210 time: 0.1148620
May 31 16:21:58.183177 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] Notify callbacks [] for port, precommit_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:58.267167 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] Transition to ACTIVE for port object 1da6e62c-8254-4b52-9755-bf21e7ceacdf will not be triggered until provisioned by entity L2. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:21:58.268949 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d6e9c03c-506a-42c2-ba37-dab70d097d3d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16621775'] for network, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:58.283335 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:58.288086 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d6e9c03c-506a-42c2-ba37-dab70d097d3d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:58.296811 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:58.301825 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:21:58.334216 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-d6e9c03c-506a-42c2-ba37-dab70d097d3d admin admin] 10.222.0.43 "DELETE /v2.0/networks/36ac85f0-2d37-4c8f-a77a-0f63488bbf39 HTTP/1.1" status: 204  len: 168 time: 1.0738292
May 31 16:21:58.334879 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 60196) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:21:58.346349 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6e9c03c-506a-42c2-ba37-dab70d097d3d admin admin] Pushing event deleted for resources: {'Network': ['ID=36ac85f0-2d37-4c8f-a77a-0f63488bbf39,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:58.351017 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d6e9c03c-506a-42c2-ba37-dab70d097d3d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:58.430706 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ef1d3b2-e8c1-466e-86ad-f6726b68351a None None] Pushing event updated for resources: {'Port': ['ID=1da6e62c-8254-4b52-9755-bf21e7ceacdf,revision_number=3']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:21:58.434247 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-1ef1d3b2-e8c1-466e-86ad-f6726b68351a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:21:58.588723 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_v2 [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] Deleting subnet fafc663d-0e06-47c9-b069-a52720c685ac {{(pid=91764) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 31 16:21:58.602600 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:59.008072 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14907384'] for subnet, precommit_delete_associations {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:59.154779 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-975336'] for subnet, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:59.203547 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] Attempting to bind port 1da6e62c-8254-4b52-9755-bf21e7ceacdf on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:21:59.204136 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] Attempting to bind port 1da6e62c-8254-4b52-9755-bf21e7ceacdf by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': 'b72084f1-c698-4897-bb6d-f45dadd02fbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 804, 'network_id': 'ebb8f1cc-6c15-416d-995e-90978c0e9eac'}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:21:59.204749 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] Attempting to bind port 1da6e62c-8254-4b52-9755-bf21e7ceacdf on network ebb8f1cc-6c15-416d-995e-90978c0e9eac {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:21:59.273713 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 21, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:21:59.274980 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] Checking segment: {'id': 'b72084f1-c698-4897-bb6d-f45dadd02fbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 804, 'network_id': 'ebb8f1cc-6c15-416d-995e-90978c0e9eac'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91765) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:21:59.274980 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:59.278174 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d727ba91-18cf-410e-9f0a-c478ab08192e req-6c137f80-ac8f-403f-9490-e8761b86d515 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:21:59.279046 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] Bound using segment: {'id': 'b72084f1-c698-4897-bb6d-f45dadd02fbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 804, 'network_id': 'ebb8f1cc-6c15-416d-995e-90978c0e9eac'} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:21:59.283452 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] Bound port: 1da6e62c-8254-4b52-9755-bf21e7ceacdf, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b72084f1-c698-4897-bb6d-f45dadd02fbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 804, 'network_id': 'ebb8f1cc-6c15-416d-995e-90978c0e9eac'}}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:21:59.290233 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:59.291574 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d727ba91-18cf-410e-9f0a-c478ab08192e req-6c137f80-ac8f-403f-9490-e8761b86d515 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.5301001
May 31 16:21:59.677968 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] For port 1da6e62c-8254-4b52-9755-bf21e7ceacdf, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91765) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:21:59.682150 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d727ba91-18cf-410e-9f0a-c478ab08192e req-f2023f03-6dbb-4206-9221-c7aa1b014d0d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3886023
May 31 16:21:59.699714 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] For port 1da6e62c-8254-4b52-9755-bf21e7ceacdf, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=1da6e62c-8254-4b52-9755-bf21e7ceacdf,segment=NetworkSegment(b72084f1-c698-4897-bb6d-f45dadd02fbd),segment_id=b72084f1-c698-4897-bb6d-f45dadd02fbd)] {{(pid=91765) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:21:59.720406 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:21:59.727577 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:00.150382 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ef1d3b2-e8c1-466e-86ad-f6726b68351a None None] Pushing event updated for resources: {'Port': ['ID=1da6e62c-8254-4b52-9755-bf21e7ceacdf,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:00.175906 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-1ef1d3b2-e8c1-466e-86ad-f6726b68351a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.448s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:00.227078 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-388ac99c-189e-4522-baa5-e187beca3878 req-fc32c16c-da5f-4b2c-a530-0c748736bb4c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 210 time: 0.1227162
May 31 16:22:00.230177 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] Routers {'1d03fb4c-8bb7-46ac-916b-6c44e5689b95'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:22:00.231370 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426213880>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:21:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['1d03fb4c-8bb7-46ac-916b-6c44e5689b95'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:22:00.325197 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-978269', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14907170', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14793691'] for subnet, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:00.332372 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-45c57dad-5592-43b5-9cb4-8dac3c1409ef admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:00.427260 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fafc663d-0e06-47c9-b069-a52720c685ac,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:00.462265 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:00.470000 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:00.470845 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:00.471680 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:00.476692 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:00.477655 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:00.480792 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:00.481535 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:00.482167 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:00.482786 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:00.483386 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:00.483976 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:00.508693 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:00.510640 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:00.539887 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/fafc663d-0e06-47c9-b069-a52720c685ac HTTP/1.1" status: 204  len: 168 time: 2.1985695
May 31 16:22:00.540505 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60224) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:00.785126 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b900b1a7-9767-4128-b508-2e463e5bc7a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-525980'] for network, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:00.862467 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] Set router 1d03fb4c-8bb7-46ac-916b-6c44e5689b95 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:22:01.118181 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b900b1a7-9767-4128-b508-2e463e5bc7a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-988775', 'neutron.services.segments.db._delete_segments_for_network-8732784586204'] for network, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:01.172904 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-b900b1a7-9767-4128-b508-2e463e5bc7a4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f14277f9a00>,) {'filters': {'network_id': ['e75c3dc0-4d36-48bc-9599-ab80099734d6']}} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:22:01.221517 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-b900b1a7-9767-4128-b508-2e463e5bc7a4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f14277f9a00>, '6d889a88-e991-48c6-9a07-d075c97567a7') {'for_net_delete': True} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:22:01.228110 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-b900b1a7-9767-4128-b508-2e463e5bc7a4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f14277f9a00>, '6d889a88-e991-48c6-9a07-d075c97567a7') {} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:22:01.286053 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b900b1a7-9767-4128-b508-2e463e5bc7a4 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732784599197', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15104868'] for segment, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:01.355005 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b900b1a7-9767-4128-b508-2e463e5bc7a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:01.399364 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b900b1a7-9767-4128-b508-2e463e5bc7a4 admin admin] Releasing vlan 840 on physical network physnet1 to pool {{(pid=91763) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 31 16:22:01.400326 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b900b1a7-9767-4128-b508-2e463e5bc7a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14337126'] for segment, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]: Traceback (most recent call last):
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:     timer()
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:     cb(*args, **kw)
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:     return func(*args, **kwargs)
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:     self._notify()
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:     self.callback(batched_events)
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:     event.method(event)
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:     aggregate_uuid = self.p_client.list_aggregates(
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:     return f(self, *a, **k)
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self._get(url).json()
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self.request(url, 'GET', **kwargs)
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:     base_url = self.get_endpoint(auth, allow=allow,
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 31 16:22:01.491310 dv-cinder-793814-1-iscsi neutron-server[91763]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 31 16:22:01.785076 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426213880>, [{'id': '1d03fb4c-8bb7-46ac-916b-6c44e5689b95', 'name': 'tempest-TestMinimumBasicScenario-348591781-router', 'tenant_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.70'}], 'enable_snat': True}, 'gw_port_id': '2f39560e-c0eb-445a-ab3c-55c4c613178f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:43Z', 'updated_at': '2021-05-31T16:21:51Z', 'revision_number': 4, 'project_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'gw_port': {'id': '2f39560e-c0eb-445a-ab3c-55c4c613178f', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:7a:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d03fb4c-8bb7-46ac-916b-6c44e5689b95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:44Z', 'updated_at': '2021-05-31T16:21:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '1da6e62c-8254-4b52-9755-bf21e7ceacdf', 'name': '', 'network_id': 'ebb8f1cc-6c15-416d-995e-90978c0e9eac', 'tenant_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'mac_address': 'fa:16:3e:ed:92:96', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1d03fb4c-8bb7-46ac-916b-6c44e5689b95', 'device_owner': 'network:router_interface', 'standard_attr_id': 354, 'fixed_ips': [{'subnet_id': '19349b15-7a29-4559-912d-95f2c3f6c489', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:50Z', 'updated_at': '2021-05-31T16:21:59Z', 'revision_number': 4, 'project_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'subnets': [{'id': '19349b15-7a29-4559-912d-95f2c3f6c489', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:22:01.798254 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c8ab98d-93eb-462b-9bdb-63295669a5ff None None] The sync data for ids ['1d03fb4c-8bb7-46ac-916b-6c44e5689b95'] in dv-cinder-793814-1-iscsi is: [{'id': '1d03fb4c-8bb7-46ac-916b-6c44e5689b95', 'name': 'tempest-TestMinimumBasicScenario-348591781-router', 'tenant_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.70'}], 'enable_snat': True}, 'gw_port_id': '2f39560e-c0eb-445a-ab3c-55c4c613178f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:43Z', 'updated_at': '2021-05-31T16:21:51Z', 'revision_number': 4, 'project_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'gw_port': {'id': '2f39560e-c0eb-445a-ab3c-55c4c613178f', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:7a:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d03fb4c-8bb7-46ac-916b-6c44e5689b95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:44Z', 'updated_at': '2021-05-31T16:21:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '1da6e62c-8254-4b52-9755-bf21e7ceacdf', 'name': '', 'network_id': 'ebb8f1cc-6c15-416d-995e-90978c0e9eac', 'tenant_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'mac_address': 'fa:16:3e:ed:92:96', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1d03fb4c-8bb7-46ac-916b-6c44e5689b95', 'device_owner': 'network:router_interface', 'standard_attr_id': 354, 'fixed_ips': [{'subnet_id': '19349b15-7a29-4559-912d-95f2c3f6c489', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:50Z', 'updated_at': '2021-05-31T16:21:59Z', 'revision_number': 4, 'project_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'subnets': [{'id': '19349b15-7a29-4559-912d-95f2c3f6c489', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:22:01.799502 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b900b1a7-9767-4128-b508-2e463e5bc7a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16621775'] for network, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:01.823746 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:01.913556 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b900b1a7-9767-4128-b508-2e463e5bc7a4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:01.932027 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b900b1a7-9767-4128-b508-2e463e5bc7a4 admin admin] Pushing event deleted for resources: {'Network': ['ID=e75c3dc0-4d36-48bc-9599-ab80099734d6,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:01.942027 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-b900b1a7-9767-4128-b508-2e463e5bc7a4 admin admin] 10.222.0.43 "DELETE /v2.0/networks/e75c3dc0-4d36-48bc-9599-ab80099734d6 HTTP/1.1" status: 204  len: 168 time: 1.3963571
May 31 16:22:01.945783 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-b900b1a7-9767-4128-b508-2e463e5bc7a4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:02.039234 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-797bec72-df87-4a5f-89d6-f08f66593174 req-fd8295e0-ce25-4b5b-a6ee-3a635375c913 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 210 time: 0.2781200
May 31 16:22:02.244486 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-7ad02de7-c7aa-4b14-a269-e40bcec09197 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:02.245675 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60244) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:02.256015 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-7ad02de7-c7aa-4b14-a269-e40bcec09197 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.63 "GET /v2.0/networks?id=5b237728-dc31-4203-bbac-66ce3db1593a HTTP/1.1" status: 200  len: 812 time: 0.6983018
May 31 16:22:02.297886 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 1da6e62c-8254-4b52-9755-bf21e7ceacdf up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:22:02.435178 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-ac0f0cf5-b5c0-4e71-a843-9702f987518d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.63 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=092115f69b8e401b8c334f7b3e797aad HTTP/1.1" status: 200  len: 380 time: 0.1546898
May 31 16:22:02.467218 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0499cf62-926f-4a57-b4c0-aa5e3658ce7b req-335d8cb5-78e8-472e-8a5e-0a219ff1436f tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:02.469497 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0499cf62-926f-4a57-b4c0-aa5e3658ce7b req-335d8cb5-78e8-472e-8a5e-0a219ff1436f tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 1.4146712
May 31 16:22:02.476038 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-b8f5cda6-4c16-48df-832e-8ef6ec58709d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Request body: {'port': {'device_id': '643ad40e-ebf7-432d-ae76-1ce2164e9eec', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'admin_state_up': True, 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'security_groups': ['b16a6ce7-d949-48d8-8c08-03576b09b2e8']}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:22:02.537117 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port 1da6e62c-8254-4b52-9755-bf21e7ceacdf completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:22:02.547998 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 1da6e62c-8254-4b52-9755-bf21e7ceacdf triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:22:02.548419 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:02.599659 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60254) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:02.775412 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-fe4b803f-17b1-4a09-96ef-b6bfc7b85551 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=a71056b86c954a28a332aee562d539a4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1743982
May 31 16:22:02.780502 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60260) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:02.796277 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2b8cc7c2-5cca-441d-b8f3-4a1880ed1a95 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:02.927505 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-b8f5cda6-4c16-48df-832e-8ef6ec58709d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:22:02.943048 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-b8f5cda6-4c16-48df-832e-8ef6ec58709d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Usage tracker for resource:port and tenant:092115f69b8e401b8c334f7b3e797aad is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:22:02.949173 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-b8f5cda6-4c16-48df-832e-8ef6ec58709d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Quota usage for port was recalculated. Used quota:2. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:22:02.952471 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:02.965323 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-b8f5cda6-4c16-48df-832e-8ef6ec58709d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:22:02.971470 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-2b8cc7c2-5cca-441d-b8f3-4a1880ed1a95 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:22:02.985517 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-2b8cc7c2-5cca-441d-b8f3-4a1880ed1a95 admin admin] Usage tracker for resource:security_group_rule and tenant:22409a019352488c87becab0e54131f5 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:22:02.997335 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-2b8cc7c2-5cca-441d-b8f3-4a1880ed1a95 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:22:03.030885 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port 1da6e62c-8254-4b52-9755-bf21e7ceacdf, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=1da6e62c-8254-4b52-9755-bf21e7ceacdf,segment=NetworkSegment(b72084f1-c698-4897-bb6d-f45dadd02fbd),segment_id=b72084f1-c698-4897-bb6d-f45dadd02fbd)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:22:03.035814 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-b8f5cda6-4c16-48df-832e-8ef6ec58709d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Made reservation on behalf of 092115f69b8e401b8c334f7b3e797aad for: {'port': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:22:03.041140 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-b8f5cda6-4c16-48df-832e-8ef6ec58709d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:03.043911 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:03.046211 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:03.088179 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-2b8cc7c2-5cca-441d-b8f3-4a1880ed1a95 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:22:03.166224 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-098f6005-0fd9-4f70-80dc-a53efd1b5ce1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:03.290093 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=1da6e62c-8254-4b52-9755-bf21e7ceacdf,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:03.298929 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:03.308342 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0499cf62-926f-4a57-b4c0-aa5e3658ce7b req-72944a70-2045-4d5e-9c4e-9b4996009d75 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.8124115
May 31 16:22:03.415332 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e60c05c2-ef62-48c3-99d7-2ecb42450489 req-24f1167e-260e-481c-a91d-09415c23dbe5 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 210 time: 0.0720310
May 31 16:22:03.458200 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2b8cc7c2-5cca-441d-b8f3-4a1880ed1a95 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:03.493865 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-098f6005-0fd9-4f70-80dc-a53efd1b5ce1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:03.554588 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2b8cc7c2-5cca-441d-b8f3-4a1880ed1a95 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:03.563821 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-b90cae57-24ff-47e5-9602-6e3fbab5d4f3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:03.576261 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-098f6005-0fd9-4f70-80dc-a53efd1b5ce1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:03.603145 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-098f6005-0fd9-4f70-80dc-a53efd1b5ce1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:03.607190 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-098f6005-0fd9-4f70-80dc-a53efd1b5ce1 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/1c45f3d2-9acf-4288-ad17-8bd9aea4cfb3 HTTP/1.1" status: 204  len: 168 time: 0.8234622
May 31 16:22:03.666187 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 60272) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:03.669835 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-2b8cc7c2-5cca-441d-b8f3-4a1880ed1a95 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=22409a019352488c87becab0e54131f5&name=default HTTP/1.1" status: 200  len: 2979 time: 1.4193103
May 31 16:22:03.671954 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b8cc7c2-5cca-441d-b8f3-4a1880ed1a95 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=51257e24-51e1-4b31-9d76-82c613421245,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:03.684447 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-2b8cc7c2-5cca-441d-b8f3-4a1880ed1a95 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:03.699526 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e87446c4-dae9-4e36-adc0-fb47a061f55a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.111s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:03.761454 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-098f6005-0fd9-4f70-80dc-a53efd1b5ce1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c45f3d2-9acf-4288-ad17-8bd9aea4cfb3,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:03.768126 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-098f6005-0fd9-4f70-80dc-a53efd1b5ce1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:03.959533 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-b8f5cda6-4c16-48df-832e-8ef6ec58709d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Allocated IP 172.20.0.5 (5b237728-dc31-4203-bbac-66ce3db1593a/995d9a2e-7e88-458e-9385-d135c0e07276/95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:22:03.989772 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3d018250-9444-4319-8636-9389c988f597 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:04.125664 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3d018250-9444-4319-8636-9389c988f597 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:04.306681 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 1da6e62c-8254-4b52-9755-bf21e7ceacdf up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:22:04.601808 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 1da6e62c-8254-4b52-9755-bf21e7ceacdf triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:22:04.602543 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:04.624927 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60288) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:04.960698 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-0a4ac766-df25-4ed4-90b6-21f3974f2ab9 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=22c9829f838a4f958e9db08e72c27f5b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3344612
May 31 16:22:04.968324 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60294) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:05.041856 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-e83c9432-146d-480b-aa9a-ffd393a484a5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:05.102785 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2fd7ea96-40f5-4958-aad2-4e015539bcd9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:05.108677 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3d018250-9444-4319-8636-9389c988f597 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:05.116669 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-e4d2ba1b-cc6e-4d9c-804b-5598326949cb req-75ce2926-1359-40cc-95e7-2bb0bb1b5f14 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Synchronizing usage tracker for tenant:092115f69b8e401b8c334f7b3e797aad on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:22:05.124720 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-651066d9-c627-493e-b99a-4132aa44018b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:05.148911 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d018250-9444-4319-8636-9389c988f597 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=51257e24-51e1-4b31-9d76-82c613421245,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:05.154184 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2fd7ea96-40f5-4958-aad2-4e015539bcd9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:05.163209 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-b8f5cda6-4c16-48df-832e-8ef6ec58709d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:05.174012 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-3d018250-9444-4319-8636-9389c988f597 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:05.216896 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3d018250-9444-4319-8636-9389c988f597 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:05.218514 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-3d018250-9444-4319-8636-9389c988f597 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/51257e24-51e1-4b31-9d76-82c613421245 HTTP/1.1" status: 204  len: 168 time: 1.5452032
May 31 16:22:05.220415 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.provisioning_blocks [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-b8f5cda6-4c16-48df-832e-8ef6ec58709d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Transition to ACTIVE for port object 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b will not be triggered until provisioned by entity DHCP. {{(pid=91764) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:22:05.259842 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-e4d2ba1b-cc6e-4d9c-804b-5598326949cb req-75ce2926-1359-40cc-95e7-2bb0bb1b5f14 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Unset dirty status for tenant:092115f69b8e401b8c334f7b3e797aad on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:22:05.261469 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e4d2ba1b-cc6e-4d9c-804b-5598326949cb req-75ce2926-1359-40cc-95e7-2bb0bb1b5f14 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 210 time: 0.3994093
May 31 16:22:05.381509 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2fd7ea96-40f5-4958-aad2-4e015539bcd9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:05.384599 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-1e671d9b-d14a-40ef-a78d-486b4eb9b9d6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:05.406841 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-199a703b-8e4f-4d5d-8a5c-a9f03bdd7c6d req-5796c4a1-d2ad-4892-8221-62ec3eab927b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:05.409370 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-199a703b-8e4f-4d5d-8a5c-a9f03bdd7c6d req-5796c4a1-d2ad-4892-8221-62ec3eab927b service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=1739d3c0e2734c8a9af5c5291aac8e25&device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 1099 time: 0.6360877
May 31 16:22:05.412226 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd7ea96-40f5-4958-aad2-4e015539bcd9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eee8665f-8258-4576-850a-87678e1dc7d8,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:05.416883 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-2fd7ea96-40f5-4958-aad2-4e015539bcd9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:05.433762 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2fd7ea96-40f5-4958-aad2-4e015539bcd9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:05.454150 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-2fd7ea96-40f5-4958-aad2-4e015539bcd9 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/eee8665f-8258-4576-850a-87678e1dc7d8 HTTP/1.1" status: 204  len: 168 time: 0.4781432
May 31 16:22:05.679037 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4231954d-6d6d-421f-86e9-9322b0570420 req-371c87b1-862f-49b4-9548-92711ea7873b tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:05.683555 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4231954d-6d6d-421f-86e9-9322b0570420 req-371c87b1-862f-49b4-9548-92711ea7873b tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.8191457
May 31 16:22:05.791759 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-199a703b-8e4f-4d5d-8a5c-a9f03bdd7c6d req-b24a58b7-7ab0-4bf7-a1e5-4176b0b347cd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:05.793570 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-199a703b-8e4f-4d5d-8a5c-a9f03bdd7c6d req-b24a58b7-7ab0-4bf7-a1e5-4176b0b347cd service neutron] 10.222.0.63 "GET /v2.0/networks?id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 HTTP/1.1" status: 200  len: 920 time: 0.3578324
May 31 16:22:05.798085 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-b8f5cda6-4c16-48df-832e-8ef6ec58709d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:05.810353 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:05.971965 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4231954d-6d6d-421f-86e9-9322b0570420 req-e4a83aa4-d205-4a25-8bca-07af997a6947 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2723510
May 31 16:22:05.985559 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-199a703b-8e4f-4d5d-8a5c-a9f03bdd7c6d req-6e3309bd-0923-4151-9e06-21442bdde36d service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=f99df66c-c850-4d01-80ae-3d312eee69db HTTP/1.1" status: 200  len: 217 time: 0.1799710
May 31 16:22:06.009207 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-b8f5cda6-4c16-48df-832e-8ef6ec58709d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Network 5b237728-dc31-4203-bbac-66ce3db1593a is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:22:06.073139 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-b8f5cda6-4c16-48df-832e-8ef6ec58709d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:22:06.083260 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8f5cda6-4c16-48df-832e-8ef6ec58709d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Pushing event updated for resources: {'Port': ['ID=95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:06.086833 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-b8f5cda6-4c16-48df-832e-8ef6ec58709d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:22:06.132482 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-b8f5cda6-4c16-48df-832e-8ef6ec58709d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.319s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:06.208235 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60324) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:06.238629 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4345481b-504a-449a-9553-4f4d3e5a061b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:06.274733 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-4345481b-504a-449a-9553-4f4d3e5a061b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:22:06.290380 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-4345481b-504a-449a-9553-4f4d3e5a061b admin admin] Usage tracker for resource:security_group_rule and tenant:d529188966d5421c93c65a3abc663aba is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:22:06.305578 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-4345481b-504a-449a-9553-4f4d3e5a061b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:22:06.328576 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-4345481b-504a-449a-9553-4f4d3e5a061b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:22:06.448486 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-199a703b-8e4f-4d5d-8a5c-a9f03bdd7c6d req-17563a00-fa0f-4207-b4bd-d0a69eae119e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:06.451369 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-199a703b-8e4f-4d5d-8a5c-a9f03bdd7c6d req-17563a00-fa0f-4207-b4bd-d0a69eae119e service neutron] 10.222.0.63 "GET /v2.0/subnets?id=b9c806fb-2a53-4445-8352-4336429eb043 HTTP/1.1" status: 200  len: 859 time: 0.4407306
May 31 16:22:06.478968 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-b8f5cda6-4c16-48df-832e-8ef6ec58709d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:06.480071 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-b8f5cda6-4c16-48df-832e-8ef6ec58709d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:06.575623 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-a7f0ae90-eed3-464f-aaed-152f0cd3b78d None None] Provisioning for port 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:22:06.595363 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-a7f0ae90-eed3-464f-aaed-152f0cd3b78d None None] Provisioning complete for port 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:22:06.596756 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-a7f0ae90-eed3-464f-aaed-152f0cd3b78d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:06.612908 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-199a703b-8e4f-4d5d-8a5c-a9f03bdd7c6d req-95cb0b02-55f8-4103-9f18-8716ed289098 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1216249
May 31 16:22:06.624440 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-b8f5cda6-4c16-48df-832e-8ef6ec58709d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.63 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 4.1533892
May 31 16:22:06.724851 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4345481b-504a-449a-9553-4f4d3e5a061b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:06.734903 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4345481b-504a-449a-9553-4f4d3e5a061b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:06.737634 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Request body: {'port': {'device_id': '643ad40e-ebf7-432d-ae76-1ce2164e9eec', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79381'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:22:06.742884 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-bf12aac8-95ea-4ffc-b5dc-81272b3e87d6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:06.817216 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-a7f0ae90-eed3-464f-aaed-152f0cd3b78d None None] Port 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:22:06.833216 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4345481b-504a-449a-9553-4f4d3e5a061b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=22a61b77-f066-46a2-b69f-8690656e660f,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:06.855652 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-4345481b-504a-449a-9553-4f4d3e5a061b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:06.912509 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-4345481b-504a-449a-9553-4f4d3e5a061b admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=d529188966d5421c93c65a3abc663aba&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7004557
May 31 16:22:06.914410 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60340) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:07.005979 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-982f423b-90db-4de9-8e8c-b69f0c4850e1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:07.117317 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-982f423b-90db-4de9-8e8c-b69f0c4850e1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:07.279236 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-982f423b-90db-4de9-8e8c-b69f0c4850e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:07.308197 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-5dc468af-3e88-44cf-88af-931503f25ef1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:07.344054 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-982f423b-90db-4de9-8e8c-b69f0c4850e1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=22a61b77-f066-46a2-b69f-8690656e660f,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:07.353403 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:07.358231 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-982f423b-90db-4de9-8e8c-b69f0c4850e1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:07.361931 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-982f423b-90db-4de9-8e8c-b69f0c4850e1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:07.367672 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-982f423b-90db-4de9-8e8c-b69f0c4850e1 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/22a61b77-f066-46a2-b69f-8690656e660f HTTP/1.1" status: 204  len: 168 time: 0.4487493
May 31 16:22:07.917219 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-199a703b-8e4f-4d5d-8a5c-a9f03bdd7c6d req-42e641b8-382e-46d2-bc8e-0a90d40ef770 service neutron] 10.222.0.63 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=segments HTTP/1.1" status: 200  len: 212 time: 1.2837906
May 31 16:22:07.936626 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:08.281671 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-bd70d658-6393-48ae-9682-f0ead54781b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:08.612972 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-199a703b-8e4f-4d5d-8a5c-a9f03bdd7c6d req-5763ce9e-8895-4cbb-ab1d-acc5d19999f6 service neutron] 10.222.0.63 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6408129
May 31 16:22:08.676699 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-201193ad-57d1-4269-9c0b-4e2f9007a68e req-8a09d94b-0b2e-4209-9f79-7ff368e721de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:08.692300 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-201193ad-57d1-4269-9c0b-4e2f9007a68e req-8a09d94b-0b2e-4209-9f79-7ff368e721de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 931 time: 1.8836622
May 31 16:22:09.165633 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:09.208906 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b {{(pid=91764) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:22:09.248889 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:09.279623 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f4a3577-19c3-46b6-8c72-464b4d594e81 req-ce47bc56-cbd5-449c-ae63-e61b927423ae tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:09.299272 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3f4a3577-19c3-46b6-8c72-464b4d594e81 req-ce47bc56-cbd5-449c-ae63-e61b927423ae tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 1.8485575
May 31 16:22:09.314722 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-201193ad-57d1-4269-9c0b-4e2f9007a68e req-912ea3d3-3858-46fb-be88-2b51de6c452d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.6050537
May 31 16:22:09.424071 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.provisioning_blocks [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Transition to ACTIVE for port object 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b will not be triggered until provisioned by entity L2. {{(pid=91764) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:22:09.452335 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:09.477196 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:09.892362 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Pushing event updated for resources: {'Port': ['ID=95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b,revision_number=2']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:09.902290 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.423s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:09.939312 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3f4a3577-19c3-46b6-8c72-464b4d594e81 req-2a5482ad-6c9c-40a3-a3f2-d5ccb550ebc0 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.6362519
May 31 16:22:10.247968 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Attempting to bind port 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b on host hv-cinder-79381 for vnic_type normal with profile  {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:22:10.249175 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Attempting to bind port 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b by drivers openvswitch,hyperv on host hv-cinder-79381 at level 0 using segments [{'id': 'fb1fd409-498f-4f29-82bc-1d244a7a3ed1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a'}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:22:10.249175 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Attempting to bind port 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b on network 5b237728-dc31-4203-bbac-66ce3db1593a {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:22:10.265255 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Port 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b on network 5b237728-dc31-4203-bbac-66ce3db1593a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79381 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 31 16:22:10.265635 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Attempting to bind port 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b on network 5b237728-dc31-4203-bbac-66ce3db1593a {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:22:10.280710 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Checking agent: {'id': '4bed2638-4d91-4afb-bf81-aacca8584621', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79381', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'started_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 21, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:22:10.281056 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Checking segment: {'id': 'fb1fd409-498f-4f29-82bc-1d244a7a3ed1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:22:10.281472 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Bound using segment: {'id': 'fb1fd409-498f-4f29-82bc-1d244a7a3ed1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a'} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:22:10.282845 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Bound port: 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b, host: hv-cinder-79381, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fb1fd409-498f-4f29-82bc-1d244a7a3ed1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a'}}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:22:10.283208 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:10.598738 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] For port 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b, host hv-cinder-79381, cleared binding levels {{(pid=91764) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:22:10.608240 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] For port 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b, host hv-cinder-79381, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b,segment=NetworkSegment(fb1fd409-498f-4f29-82bc-1d244a7a3ed1),segment_id=fb1fd409-498f-4f29-82bc-1d244a7a3ed1)] {{(pid=91764) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:22:10.622773 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:10.627508 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:10.859110 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:10.860059 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:10.862301 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] 10.222.0.63 "PUT /v2.0/ports/95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b HTTP/1.1" status: 200  len: 1093 time: 4.1468701
May 31 16:22:10.862995 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '643ad40e-ebf7-432d-ae76-1ce2164e9eec', 'tag': '95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:22:10.865959 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4d00a820-c6ec-4010-9916-293331721edc" -d '{"events": [{"name": "network-changed", "server_uuid": "643ad40e-ebf7-432d-ae76-1ce2164e9eec", "tag": "95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:22:10.948206 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:11.330777 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Pushing event updated for resources: {'Port': ['ID=95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b,revision_number=3']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:11.350042 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.722s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:11.382679 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c3432f6-b7a3-4e76-aa46-61fdc0baf28c req-03d68889-a779-4b5b-b0fc-eb686916b563 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:11.384816 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2c3432f6-b7a3-4e76-aa46-61fdc0baf28c req-03d68889-a779-4b5b-b0fc-eb686916b563 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 943 time: 0.5884528
May 31 16:22:11.429855 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dd76524-d5fc-4f4f-aa7f-b5968a3a63f0 req-c775be77-0212-44ee-aaa2-3fb4207eb084 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:11.437378 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8dd76524-d5fc-4f4f-aa7f-b5968a3a63f0 req-c775be77-0212-44ee-aaa2-3fb4207eb084 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.6598413
May 31 16:22:11.494517 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-b911fc2d-7dd7-40c0-a480-c3daf1d37578 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:11.496022 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-b911fc2d-7dd7-40c0-a480-c3daf1d37578 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=092115f69b8e401b8c334f7b3e797aad&device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 1096 time: 0.3239403
May 31 16:22:11.511595 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2c3432f6-b7a3-4e76-aa46-61fdc0baf28c req-a1435852-e288-4356-a449-a41d34a4c84e tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1174374
May 31 16:22:11.590347 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8dd76524-d5fc-4f4f-aa7f-b5968a3a63f0 req-8b46cd87-935b-4b24-bf30-66110ecc0eea tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1519065
May 31 16:22:11.653776 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-487e8db9-2ecb-42ec-b2a2-c4c5bade9b34 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b HTTP/1.1" status: 200  len: 217 time: 0.1390460
May 31 16:22:11.899669 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-bef8401d-14f0-4185-b87a-e529557c1801 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:11.901626 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-bef8401d-14f0-4185-b87a-e529557c1801 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=995d9a2e-7e88-458e-9385-d135c0e07276 HTTP/1.1" status: 200  len: 851 time: 0.2337341
May 31 16:22:12.327699 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-17e978cb-138c-4def-a188-f6d8581d9a70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:12.330344 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-17e978cb-138c-4def-a188-f6d8581d9a70 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=5b237728-dc31-4203-bbac-66ce3db1593a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.4190075
May 31 16:22:12.395397 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70725e9a-3691-4bb7-9724-d3927e85b3a1 req-33d6a569-ab9f-468c-aded-a4629c22eedb tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:12.434901 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-70725e9a-3691-4bb7-9724-d3927e85b3a1 req-33d6a569-ab9f-468c-aded-a4629c22eedb tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.4562907
May 31 16:22:12.869607 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:22:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de9ef331-3816-41a1-b544-6ffa678370bc x-openstack-request-id: req-de9ef331-3816-41a1-b544-6ffa678370bc {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:22:12.869877 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "643ad40e-ebf7-432d-ae76-1ce2164e9eec", "tag": "95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:22:12.881927 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-de9ef331-3816-41a1-b544-6ffa678370bc {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:22:12.884731 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '643ad40e-ebf7-432d-ae76-1ce2164e9eec', 'tag': '95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b', 'status': 'completed', 'code': 200}
May 31 16:22:13.034137 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-70725e9a-3691-4bb7-9724-d3927e85b3a1 req-86905a69-fc32-404f-8a62-3129d29b5dd1 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.5978153
May 31 16:22:13.155651 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-35de515d-f47b-435d-83d8-28accb05b93f req-0811ebec-8123-4a8d-95c7-936e4e152b72 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.9781134
May 31 16:22:13.291447 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aec8b22d-83ad-4bd8-9058-a9c9641f0ceb req-4ea54c70-1c21-4197-abe5-0e6ca2fad5b5 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:13.293043 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-aec8b22d-83ad-4bd8-9058-a9c9641f0ceb req-4ea54c70-1c21-4197-abe5-0e6ca2fad5b5 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 943 time: 0.2562940
May 31 16:22:13.361991 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-f926f426-cff7-45a1-84a7-944c2c593641 service neutron] 10.222.0.63 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=segments HTTP/1.1" status: 200  len: 212 time: 1.0210979
May 31 16:22:13.520382 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35de515d-f47b-435d-83d8-28accb05b93f req-6d9c2df3-9410-4149-b966-0fed14f4e5b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:13.522246 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-35de515d-f47b-435d-83d8-28accb05b93f req-6d9c2df3-9410-4149-b966-0fed14f4e5b0 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=1739d3c0e2734c8a9af5c5291aac8e25&device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 1099 time: 0.3209615
May 31 16:22:13.756436 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-aec8b22d-83ad-4bd8-9058-a9c9641f0ceb req-a365d9dd-d9d4-4f93-9eb1-648c4c95a4ac tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.4523437
May 31 16:22:13.757962 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35de515d-f47b-435d-83d8-28accb05b93f req-5ceabc63-056f-4584-bccd-f8d3e4a654eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:13.762602 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-35de515d-f47b-435d-83d8-28accb05b93f req-5ceabc63-056f-4584-bccd-f8d3e4a654eb service neutron] 10.222.0.63 "GET /v2.0/networks?id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 HTTP/1.1" status: 200  len: 920 time: 0.1823316
May 31 16:22:13.902862 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-35de515d-f47b-435d-83d8-28accb05b93f req-aad7a195-027e-4354-a728-6568bb15bc71 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=f99df66c-c850-4d01-80ae-3d312eee69db HTTP/1.1" status: 200  len: 217 time: 0.1151645
May 31 16:22:14.021794 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-766cb0ec-8ab4-43bf-adbf-8f95385951b7 req-8ee5eeb3-1e23-4a9c-963d-4b493f2a824a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:14.023406 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-766cb0ec-8ab4-43bf-adbf-8f95385951b7 req-8ee5eeb3-1e23-4a9c-963d-4b493f2a824a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.7517800
May 31 16:22:14.027736 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1dacfed2-75da-48e7-9adc-2b15ace4c015 req-7dfa8f9b-bbcd-4354-9557-c910986e3c57 service neutron] 10.222.0.63 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6378236
May 31 16:22:14.050764 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35de515d-f47b-435d-83d8-28accb05b93f req-042fc546-c87b-4e86-85d7-deecb07f0502 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:14.052555 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-35de515d-f47b-435d-83d8-28accb05b93f req-042fc546-c87b-4e86-85d7-deecb07f0502 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=b9c806fb-2a53-4445-8352-4336429eb043 HTTP/1.1" status: 200  len: 859 time: 0.1248486
May 31 16:22:14.329409 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-35de515d-f47b-435d-83d8-28accb05b93f req-0cbfb465-c27d-4201-8d93-2193a78dbace service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.2340040
May 31 16:22:14.466336 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-766cb0ec-8ab4-43bf-adbf-8f95385951b7 req-98b01a08-42f1-4dbf-8908-17953c81a552 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.4268909
May 31 16:22:14.876681 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d00a820-c6ec-4010-9916-293331721edc req-cfa2b521-6bce-454b-9868-57d9207253a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:14.878940 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4d00a820-c6ec-4010-9916-293331721edc req-cfa2b521-6bce-454b-9868-57d9207253a6 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=092115f69b8e401b8c334f7b3e797aad&device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 1096 time: 0.6589029
May 31 16:22:14.935959 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-35de515d-f47b-435d-83d8-28accb05b93f req-a5dd7fa6-782e-4e31-bdcd-deac386170bb service neutron] 10.222.0.63 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5695379
May 31 16:22:15.285694 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fff8582-e591-4cf9-a0e2-b8110b0cb65c req-23ac81c6-524c-4536-8013-c56a268f53ca tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:15.288317 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5fff8582-e591-4cf9-a0e2-b8110b0cb65c req-23ac81c6-524c-4536-8013-c56a268f53ca tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.5150933
May 31 16:22:15.466480 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5fff8582-e591-4cf9-a0e2-b8110b0cb65c req-b51fb45a-d427-46ab-b601-ee9866ea8a70 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1635895
May 31 16:22:15.580602 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d00a820-c6ec-4010-9916-293331721edc req-14aa73a3-c7b0-4aab-9741-8556e23f3fd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:15.583233 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4d00a820-c6ec-4010-9916-293331721edc req-14aa73a3-c7b0-4aab-9741-8556e23f3fd6 service neutron] 10.222.0.63 "GET /v2.0/networks?id=5b237728-dc31-4203-bbac-66ce3db1593a HTTP/1.1" status: 200  len: 913 time: 0.6788673
May 31 16:22:15.595891 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-35de515d-f47b-435d-83d8-28accb05b93f req-7658ac36-62b6-46fd-add8-0792bbfedfca service neutron] 10.222.0.63 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6027231
May 31 16:22:15.610459 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6131e79-67c2-45be-aab7-583b5c357a42 req-f15f6774-f4b9-40e6-ba82-a76a115517db tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:15.614043 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d6131e79-67c2-45be-aab7-583b5c357a42 req-f15f6774-f4b9-40e6-ba82-a76a115517db tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 943 time: 0.6220617
May 31 16:22:15.755499 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4d00a820-c6ec-4010-9916-293331721edc req-50e07420-ea30-4162-8219-f20b42f6c489 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b HTTP/1.1" status: 200  len: 217 time: 0.1396220
May 31 16:22:15.895955 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d6131e79-67c2-45be-aab7-583b5c357a42 req-179bcf2f-2c0a-42df-8885-8572f78900c6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1799862
May 31 16:22:15.918099 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d00a820-c6ec-4010-9916-293331721edc req-c2a305ac-d739-4e63-85e7-c21ef09350ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:15.920852 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4d00a820-c6ec-4010-9916-293331721edc req-c2a305ac-d739-4e63-85e7-c21ef09350ab service neutron] 10.222.0.63 "GET /v2.0/subnets?id=995d9a2e-7e88-458e-9385-d135c0e07276 HTTP/1.1" status: 200  len: 851 time: 0.1540143
May 31 16:22:16.087583 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d00a820-c6ec-4010-9916-293331721edc req-9cbb222f-114f-4bc9-b12e-0146836b3f84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:16.095441 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4d00a820-c6ec-4010-9916-293331721edc req-9cbb222f-114f-4bc9-b12e-0146836b3f84 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=5b237728-dc31-4203-bbac-66ce3db1593a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1572628
May 31 16:22:16.555741 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4d00a820-c6ec-4010-9916-293331721edc req-ac6ea2e5-8668-495d-a632-73a6087579dc service neutron] 10.222.0.63 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4535263
May 31 16:22:16.580839 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c0371da-79d1-4463-8d91-330ad3f2bcd4 req-98d17945-cd69-42db-b7af-1232de2d7b0d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:16.582708 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2c0371da-79d1-4463-8d91-330ad3f2bcd4 req-98d17945-cd69-42db-b7af-1232de2d7b0d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.2138479
May 31 16:22:16.775461 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2c0371da-79d1-4463-8d91-330ad3f2bcd4 req-c14378d1-dd48-417f-b237-5e033f2dc146 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1649449
May 31 16:22:16.911985 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4d00a820-c6ec-4010-9916-293331721edc req-4fcc5413-2507-41c3-9b39-09e05801ecdb service neutron] 10.222.0.63 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3277805
May 31 16:22:17.276523 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-287eb646-f8f8-4dc0-9dc9-c9405b995002 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:17.283581 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-287eb646-f8f8-4dc0-9dc9-c9405b995002 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/networks?id=1097eeec-06a4-406d-ab4a-02e0123072d2 HTTP/1.1" status: 200  len: 814 time: 0.3653753
May 31 16:22:17.306532 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac2d024e-8efd-402f-b440-7fe3f723e5c7 req-4832a111-8f3e-4f80-88fa-0a7df98bb809 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:17.308083 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ac2d024e-8efd-402f-b440-7fe3f723e5c7 req-4832a111-8f3e-4f80-88fa-0a7df98bb809 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 943 time: 0.1877511
May 31 16:22:17.315081 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-5527cedc-e337-4c3c-8905-20069c8eadf0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/quotas/0eb6e65b3f844417816fb1e5c88a8004 HTTP/1.1" status: 200  len: 375 time: 0.0304763
May 31 16:22:17.420223 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ac2d024e-8efd-402f-b440-7fe3f723e5c7 req-1319e6bb-d203-4654-97c4-d64c58aee882 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0636384
May 31 16:22:17.479775 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-9851fcbb-0c07-4d6b-9175-fe765da16996 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=0eb6e65b3f844417816fb1e5c88a8004&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1614001
May 31 16:22:17.783778 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-b9ef5df7-9b93-4f07-a672-53c528429d9a service neutron] 10.222.0.43 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2995806
May 31 16:22:18.139747 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-68359142-eb32-45a3-b104-d41baa1efcda service neutron] 10.222.0.43 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3448031
May 31 16:22:18.236941 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8999a73a-8a8d-43f6-a0ee-8493ad25edee req-a7f130e5-a496-4786-9c6d-832e07fa2800 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:18.247392 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8999a73a-8a8d-43f6-a0ee-8493ad25edee req-a7f130e5-a496-4786-9c6d-832e07fa2800 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.1684980
May 31 16:22:18.333236 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8999a73a-8a8d-43f6-a0ee-8493ad25edee req-80a87653-a941-4bcc-a907-03c528eb7669 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0768867
May 31 16:22:18.661830 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-87a16c51-6608-4e99-8c5b-76d6103f190b req-b3919188-a817-4222-a238-8712e412fb89 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 210 time: 0.1388423
May 31 16:22:19.018393 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f525212-e97e-427d-9391-c29fdb361d05 req-6b126e0c-245b-419e-a025-746a71968a6c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:19.026930 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9f525212-e97e-427d-9391-c29fdb361d05 req-6b126e0c-245b-419e-a025-746a71968a6c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 943 time: 0.2962587
May 31 16:22:19.120940 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9f525212-e97e-427d-9391-c29fdb361d05 req-c5ba3bdc-796e-40f3-ab8e-3793520affd0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0928650
May 31 16:22:19.259981 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60588) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:19.488708 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-63764b3e-bc5c-447d-a20a-222b87bf4b48 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:19.516034 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-63764b3e-bc5c-447d-a20a-222b87bf4b48 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:22:19.521261 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-63764b3e-bc5c-447d-a20a-222b87bf4b48 admin admin] Usage tracker for resource:security_group_rule and tenant:b5b67ff40ab64527898d2b08b13d7631 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:22:19.526106 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-63764b3e-bc5c-447d-a20a-222b87bf4b48 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:22:19.536961 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-63764b3e-bc5c-447d-a20a-222b87bf4b48 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:22:19.594838 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:19.708408 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23a3f543-3419-4aa9-8bb7-07ff9a70b61b req-fa3ac2ac-f41a-464b-b871-7029d45d1693 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:19.710437 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-23a3f543-3419-4aa9-8bb7-07ff9a70b61b req-fa3ac2ac-f41a-464b-b871-7029d45d1693 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.1656153
May 31 16:22:19.730330 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-63764b3e-bc5c-447d-a20a-222b87bf4b48 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:19.739397 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-63764b3e-bc5c-447d-a20a-222b87bf4b48 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:19.767304 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-30513076-3a71-4fa5-938b-1044cb69a083 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:19.777601 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-23a3f543-3419-4aa9-8bb7-07ff9a70b61b req-e0a52a10-e7dd-41cd-8790-0782333f76ff tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0509610
May 31 16:22:19.827170 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-63764b3e-bc5c-447d-a20a-222b87bf4b48 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=b5b67ff40ab64527898d2b08b13d7631&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5645845
May 31 16:22:19.828125 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60606) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:19.863033 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63764b3e-bc5c-447d-a20a-222b87bf4b48 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=26abfbe2-e177-42d6-bb24-8e319afb9591,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:19.865174 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-28c56810-56a4-4d0c-8235-a0926ea6244b req-54682126-e0e3-4ffd-8b20-2dbce1fcd88a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 210 time: 0.0612323
May 31 16:22:19.870570 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-63764b3e-bc5c-447d-a20a-222b87bf4b48 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:19.931728 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0a8aaa82-d13a-4a55-b3d6-c0c0a56fa676 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:19.965337 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0a8aaa82-d13a-4a55-b3d6-c0c0a56fa676 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:20.030700 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0a8aaa82-d13a-4a55-b3d6-c0c0a56fa676 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:20.036284 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:20.052645 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a8aaa82-d13a-4a55-b3d6-c0c0a56fa676 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=26abfbe2-e177-42d6-bb24-8e319afb9591,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:20.056776 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-0a8aaa82-d13a-4a55-b3d6-c0c0a56fa676 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:20.060717 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0a8aaa82-d13a-4a55-b3d6-c0c0a56fa676 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:20.067003 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-0a8aaa82-d13a-4a55-b3d6-c0c0a56fa676 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/26abfbe2-e177-42d6-bb24-8e319afb9591 HTTP/1.1" status: 204  len: 168 time: 0.2268486
May 31 16:22:20.408560 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f55dd63b-432c-4ea0-b972-cc779a4be967 req-95566d36-dd65-49d5-ae72-2e874164f31e tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:20.411218 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f55dd63b-432c-4ea0-b972-cc779a4be967 req-95566d36-dd65-49d5-ae72-2e874164f31e tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 943 time: 0.1571777
May 31 16:22:20.539893 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60636) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:20.586409 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f55dd63b-432c-4ea0-b972-cc779a4be967 req-06a3f4c9-e2bc-4bd0-867e-3106bbec32ef tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1618571
May 31 16:22:20.589930 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7e8cd5d6-6af6-4472-9928-e306c87adcde admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:20.622933 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-7e8cd5d6-6af6-4472-9928-e306c87adcde admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:22:20.630624 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-7e8cd5d6-6af6-4472-9928-e306c87adcde admin admin] Usage tracker for resource:security_group_rule and tenant:f24b4afb9b0e415fb11af1d3daa36e24 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:22:20.635787 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-7e8cd5d6-6af6-4472-9928-e306c87adcde admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:22:20.645003 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-7e8cd5d6-6af6-4472-9928-e306c87adcde admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:22:20.839253 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7e8cd5d6-6af6-4472-9928-e306c87adcde admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:20.848328 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7e8cd5d6-6af6-4472-9928-e306c87adcde admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:20.890534 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-58cf8c7c-1a7d-4002-8cba-4e9197d107b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:20.908748 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-7e8cd5d6-6af6-4472-9928-e306c87adcde admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=f24b4afb9b0e415fb11af1d3daa36e24&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3668578
May 31 16:22:20.913179 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60648) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:20.913846 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-ceeb9a13-5347-4be6-8e21-5b871eddeeb4 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:20.926370 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-ceeb9a13-5347-4be6-8e21-5b871eddeeb4 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/networks?id=e3df5118-0a40-4a66-b31c-a978a0c899cf HTTP/1.1" status: 200  len: 814 time: 0.4844208
May 31 16:22:20.959423 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e8cd5d6-6af6-4472-9928-e306c87adcde admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0b1ba25f-b990-4494-972e-5a85a50bcb7e,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:20.966599 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-7e8cd5d6-6af6-4472-9928-e306c87adcde admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:21.007817 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-983cfaee-88b5-4e65-8f60-670a29e65c3a tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/quotas/8e66b29e29094a429643e0308704753b HTTP/1.1" status: 200  len: 375 time: 0.0703850
May 31 16:22:21.025245 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-97222ae9-67eb-467a-a23c-0c7a6b0a3274 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:21.056522 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-97222ae9-67eb-467a-a23c-0c7a6b0a3274 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:21.140707 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-97222ae9-67eb-467a-a23c-0c7a6b0a3274 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:21.149027 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e4b3cd10-4f63-49f0-bf31-e9c603a3890a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:21.161265 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97222ae9-67eb-467a-a23c-0c7a6b0a3274 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0b1ba25f-b990-4494-972e-5a85a50bcb7e,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:21.167796 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-97222ae9-67eb-467a-a23c-0c7a6b0a3274 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:21.178327 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-97222ae9-67eb-467a-a23c-0c7a6b0a3274 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:21.182351 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-97222ae9-67eb-467a-a23c-0c7a6b0a3274 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/0b1ba25f-b990-4494-972e-5a85a50bcb7e HTTP/1.1" status: 204  len: 168 time: 0.2659039
May 31 16:22:21.303536 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-d6f99f95-1de7-4bb0-a0cc-76030ffe4d7e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:21.305880 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-d6f99f95-1de7-4bb0-a0cc-76030ffe4d7e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.63 "GET /v2.0/networks?id=1097eeec-06a4-406d-ab4a-02e0123072d2 HTTP/1.1" status: 200  len: 814 time: 0.6442983
May 31 16:22:21.333767 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-d930ba93-8ee0-4a63-851f-7f00d4e1d068 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Request body: {'port': {'device_id': '69990510-6c38-4988-a0ec-18ae79233830', 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2', 'admin_state_up': True, 'tenant_id': '0eb6e65b3f844417816fb1e5c88a8004'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:22:21.489811 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6aa456b-5d17-4be9-bde6-61bf48c1941f req-c41c8e7c-5215-431d-b2e5-6db9b77f2fd0 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:21.491387 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d6aa456b-5d17-4be9-bde6-61bf48c1941f req-c41c8e7c-5215-431d-b2e5-6db9b77f2fd0 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.4746854
May 31 16:22:21.503002 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-aeaa2ecc-1ba2-493d-afb7-f205289f89e1 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=8e66b29e29094a429643e0308704753b&fields=id HTTP/1.1" status: 200  len: 302 time: 0.4939768
May 31 16:22:21.769041 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d6aa456b-5d17-4be9-bde6-61bf48c1941f req-f9441174-852f-4392-9670-457c8d729276 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2611749
May 31 16:22:21.839782 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-d930ba93-8ee0-4a63-851f-7f00d4e1d068 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:22:21.858372 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-5e1a7d75-9864-4afc-bdd6-7f9cdcaf1408 service neutron] 10.222.0.43 "GET /v2.0/networks/e3df5118-0a40-4a66-b31c-a978a0c899cf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3265438
May 31 16:22:21.866160 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-d930ba93-8ee0-4a63-851f-7f00d4e1d068 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:22:22.144672 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:22:22.174692 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-be8570f8-9827-4a2a-885b-e88a18ae380e req-ca7aa1da-8461-4487-b3ba-bd961818af9a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 210 time: 0.2623568
May 31 16:22:22.181092 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-d930ba93-8ee0-4a63-851f-7f00d4e1d068 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Made reservation on behalf of 0eb6e65b3f844417816fb1e5c88a8004 for: {'port': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:22:22.184679 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-d930ba93-8ee0-4a63-851f-7f00d4e1d068 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:22.354236 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c32a6a8e-ee34-4f42-8d0f-bfba7ce558fb service neutron] 10.222.0.43 "GET /v2.0/networks/e3df5118-0a40-4a66-b31c-a978a0c899cf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4803991
May 31 16:22:22.464271 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b,segment=NetworkSegment(fb1fd409-498f-4f29-82bc-1d244a7a3ed1),segment_id=fb1fd409-498f-4f29-82bc-1d244a7a3ed1)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:22:22.478808 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-d930ba93-8ee0-4a63-851f-7f00d4e1d068 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Allocated IP 172.20.0.9 (1097eeec-06a4-406d-ab4a-02e0123072d2/68c4d303-4299-4977-888e-57c80b8530cc/ed28e094-e3fd-4150-b73d-a9ce8dff7be4) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:22:22.495416 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': '95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'port_id': '95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b', 'mac_address': 'fa:16:3e:1a:ff:75', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 805, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:22:22.631140 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:22.656207 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:22:22.690780 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b,segment=NetworkSegment(fb1fd409-498f-4f29-82bc-1d244a7a3ed1),segment_id=fb1fd409-498f-4f29-82bc-1d244a7a3ed1)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:22:22.698838 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:22.700985 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:22.788277 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-fbbea0ec-16e3-4308-8366-97fe6c486755 req-ec7c3244-6b58-4a6f-a4ed-89266608a85c tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 210 time: 0.1164038
May 31 16:22:22.846706 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-d930ba93-8ee0-4a63-851f-7f00d4e1d068 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:22.868617 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:22.897004 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:22.897207 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:22.897372 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:22.897936 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:22.898481 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:22.898962 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:22.899541 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:22.900185 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:22.900719 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:22.901368 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:22.902109 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:22.902661 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:22:22.905813 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cf4ec28-6e31-4f1e-8a8e-0b26e1fdf82d req-0e939c0c-cf00-40ae-89a7-2154b41868bc tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:22.907468 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0cf4ec28-6e31-4f1e-8a8e-0b26e1fdf82d req-0e939c0c-cf00-40ae-89a7-2154b41868bc tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 944 time: 0.2394021
May 31 16:22:22.909711 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.208s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:22.990676 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0cf4ec28-6e31-4f1e-8a8e-0b26e1fdf82d req-162e431f-178a-4927-9c2b-6ef0a24eb706 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0564706
May 31 16:22:22.992711 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-d930ba93-8ee0-4a63-851f-7f00d4e1d068 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:23.001591 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-4dedc8ce-ca68-4aab-9f4b-3308a610e0f0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:23.008967 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['5591c8db-5905-4285-84f7-5743de100fc2', 'a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9', 'a94146eb-55eb-45df-b975-f2732f9d455d'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:22:23.103210 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-d930ba93-8ee0-4a63-851f-7f00d4e1d068 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Network 1097eeec-06a4-406d-ab4a-02e0123072d2 is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:22:23.107388 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-d930ba93-8ee0-4a63-851f-7f00d4e1d068 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:22:23.134936 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-d930ba93-8ee0-4a63-851f-7f00d4e1d068 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:22:23.135171 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:22:23.176455 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d930ba93-8ee0-4a63-851f-7f00d4e1d068 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Pushing event updated for resources: {'Port': ['ID=ed28e094-e3fd-4150-b73d-a9ce8dff7be4,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:23.241089 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-d930ba93-8ee0-4a63-851f-7f00d4e1d068 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:23.319917 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-d930ba93-8ee0-4a63-851f-7f00d4e1d068 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:23.320597 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-d930ba93-8ee0-4a63-851f-7f00d4e1d068 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:23.384321 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd869df9-f48f-49b5-be1b-034a35df3404 req-5d09d077-c6fa-4b16-bfcf-300aaafd5ae9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:23.397725 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-fd869df9-f48f-49b5-be1b-034a35df3404 req-5d09d077-c6fa-4b16-bfcf-300aaafd5ae9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.2146873
May 31 16:22:23.465196 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-d930ba93-8ee0-4a63-851f-7f00d4e1d068 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.63 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.1433163
May 31 16:22:23.496810 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Request body: {'port': {'device_id': '69990510-6c38-4988-a0ec-18ae79233830', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79381'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:22:23.587033 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-fd869df9-f48f-49b5-be1b-034a35df3404 req-8c02ce74-e29b-4339-a55e-93e1ff59ac02 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1883726
May 31 16:22:23.673471 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7926edea-c957-4c38-be0d-618853157c50 req-307c32ed-d802-4997-a6e2-95582dc6036d tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:23.674397 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-7926edea-c957-4c38-be0d-618853157c50 req-307c32ed-d802-4997-a6e2-95582dc6036d tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Synchronizing usage tracker for tenant:0eb6e65b3f844417816fb1e5c88a8004 on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:22:23.687804 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:23.750779 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-7926edea-c957-4c38-be0d-618853157c50 req-307c32ed-d802-4997-a6e2-95582dc6036d tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Unset dirty status for tenant:0eb6e65b3f844417816fb1e5c88a8004 on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:22:23.759339 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7926edea-c957-4c38-be0d-618853157c50 req-307c32ed-d802-4997-a6e2-95582dc6036d tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 931 time: 0.3399987
May 31 16:22:23.832440 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7926edea-c957-4c38-be0d-618853157c50 req-3abfe376-b452-4e90-a38f-d405522cf358 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0719357
May 31 16:22:24.103085 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-71970878-4369-419a-bafd-08ef37e8eb56 req-d063fe0c-bce8-4f3e-8475-aca81d531d44 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 210 time: 0.1321242
May 31 16:22:24.422590 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02535682-909d-4fce-b179-7b2b87f2d35b req-dfe7ab1f-c438-4e5e-9a5e-f6001d901e8d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:24.424098 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-02535682-909d-4fce-b179-7b2b87f2d35b req-dfe7ab1f-c438-4e5e-9a5e-f6001d901e8d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 944 time: 0.1421275
May 31 16:22:24.545155 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-02535682-909d-4fce-b179-7b2b87f2d35b req-893e4cb2-3212-4859-b944-2493a2caa945 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0997074
May 31 16:22:24.549716 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ed28e094-e3fd-4150-b73d-a9ce8dff7be4 {{(pid=91764) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:22:24.570820 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:24.592706 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.provisioning_blocks [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Transition to ACTIVE for port object ed28e094-e3fd-4150-b73d-a9ce8dff7be4 will not be triggered until provisioned by entity L2. {{(pid=91764) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:22:24.599326 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:24.605328 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:24.877947 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Pushing event updated for resources: {'Port': ['ID=ed28e094-e3fd-4150-b73d-a9ce8dff7be4,revision_number=2']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:24.938870 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.333s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:24.972300 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Attempting to bind port ed28e094-e3fd-4150-b73d-a9ce8dff7be4 on host hv-cinder-79381 for vnic_type normal with profile  {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:22:24.972655 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Attempting to bind port ed28e094-e3fd-4150-b73d-a9ce8dff7be4 by drivers openvswitch,hyperv on host hv-cinder-79381 at level 0 using segments [{'id': '016e9daa-b906-4ec8-978d-cb58fbcd78da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2'}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:22:24.972991 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Attempting to bind port ed28e094-e3fd-4150-b73d-a9ce8dff7be4 on network 1097eeec-06a4-406d-ab4a-02e0123072d2 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:22:24.979124 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Port ed28e094-e3fd-4150-b73d-a9ce8dff7be4 on network 1097eeec-06a4-406d-ab4a-02e0123072d2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79381 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 31 16:22:24.979449 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Attempting to bind port ed28e094-e3fd-4150-b73d-a9ce8dff7be4 on network 1097eeec-06a4-406d-ab4a-02e0123072d2 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:22:24.992093 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Checking agent: {'id': '4bed2638-4d91-4afb-bf81-aacca8584621', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79381', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'started_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 22, 20), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:22:24.993732 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Checking segment: {'id': '016e9daa-b906-4ec8-978d-cb58fbcd78da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:22:24.994157 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Bound using segment: {'id': '016e9daa-b906-4ec8-978d-cb58fbcd78da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2'} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:22:24.995774 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Bound port: ed28e094-e3fd-4150-b73d-a9ce8dff7be4, host: hv-cinder-79381, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '016e9daa-b906-4ec8-978d-cb58fbcd78da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 838, 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2'}}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:22:24.997123 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:25.183854 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60764) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:25.348053 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0b59cb61-9987-453f-993e-42b6238dc7f9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:25.367266 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-0b59cb61-9987-453f-993e-42b6238dc7f9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:22:25.372647 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-0b59cb61-9987-453f-993e-42b6238dc7f9 admin admin] Usage tracker for resource:security_group_rule and tenant:6ab5f4f9d7624e368bf651fdf679275c is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:22:25.376873 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-0b59cb61-9987-453f-993e-42b6238dc7f9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:22:25.385090 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-0b59cb61-9987-453f-993e-42b6238dc7f9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:22:25.400262 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] For port ed28e094-e3fd-4150-b73d-a9ce8dff7be4, host hv-cinder-79381, cleared binding levels {{(pid=91764) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:22:25.432775 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] For port ed28e094-e3fd-4150-b73d-a9ce8dff7be4, host hv-cinder-79381, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=ed28e094-e3fd-4150-b73d-a9ce8dff7be4,segment=NetworkSegment(016e9daa-b906-4ec8-978d-cb58fbcd78da),segment_id=016e9daa-b906-4ec8-978d-cb58fbcd78da)] {{(pid=91764) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:22:25.445979 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-5d6e8632-702c-45f6-82e1-abf78322934f tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:25.447456 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-5d6e8632-702c-45f6-82e1-abf78322934f tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.63 "GET /v2.0/networks?id=e3df5118-0a40-4a66-b31c-a978a0c899cf HTTP/1.1" status: 200  len: 814 time: 0.4183357
May 31 16:22:25.452818 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:25.460725 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:25.482044 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0b59cb61-9987-453f-993e-42b6238dc7f9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:25.488080 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0b59cb61-9987-453f-993e-42b6238dc7f9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:25.497143 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-4345481b-504a-449a-9553-4f4d3e5a061b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:25.504048 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-3327bf9c-885e-4e31-a7b0-ab890653a077 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Request body: {'port': {'device_id': '1d2436ad-b7ce-4d4c-851a-544a84fe2ef5', 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf', 'admin_state_up': True, 'tenant_id': '8e66b29e29094a429643e0308704753b'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:22:25.538932 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66268e5c-453c-4535-8cab-e520085b8c24 req-bcdf7c05-a9d7-45a5-be98-e5f9f86628f6 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:25.541880 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-66268e5c-453c-4535-8cab-e520085b8c24 req-bcdf7c05-a9d7-45a5-be98-e5f9f86628f6 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.3207438
May 31 16:22:25.544374 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b59cb61-9987-453f-993e-42b6238dc7f9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1e5342bd-b47c-44f0-b22d-afadaba29bdf,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:25.550635 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-0b59cb61-9987-453f-993e-42b6238dc7f9 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=6ab5f4f9d7624e368bf651fdf679275c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3681207
May 31 16:22:25.552214 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-0b59cb61-9987-453f-993e-42b6238dc7f9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:25.553297 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60782) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:25.593933 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d93e1c1a-9dba-4c49-9de9-a5430c640107 req-2c3733d4-309b-45a3-88cf-fca739df0fb2 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:25.595692 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d93e1c1a-9dba-4c49-9de9-a5430c640107 req-2c3733d4-309b-45a3-88cf-fca739df0fb2 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.4960048
May 31 16:22:25.609984 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:25.610595 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:25.611952 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] 10.222.0.63 "PUT /v2.0/ports/ed28e094-e3fd-4150-b73d-a9ce8dff7be4 HTTP/1.1" status: 200  len: 1093 time: 2.1252108
May 31 16:22:25.639879 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3f501637-ea91-47aa-947e-02d3fb3fae7d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:25.661266 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '69990510-6c38-4988-a0ec-18ae79233830', 'tag': 'ed28e094-e3fd-4150-b73d-a9ce8dff7be4'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:22:25.663991 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cbf8a899-671f-44bc-b3c7-5e7428830771" -d '{"events": [{"name": "network-changed", "server_uuid": "69990510-6c38-4988-a0ec-18ae79233830", "tag": "ed28e094-e3fd-4150-b73d-a9ce8dff7be4"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:22:25.684326 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3f501637-ea91-47aa-947e-02d3fb3fae7d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:25.759444 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3f501637-ea91-47aa-947e-02d3fb3fae7d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:25.768183 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-b93e920b-6463-4d83-b58c-178f63a0d0fb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:25.794373 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f501637-ea91-47aa-947e-02d3fb3fae7d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1e5342bd-b47c-44f0-b22d-afadaba29bdf,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:25.799250 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-3f501637-ea91-47aa-947e-02d3fb3fae7d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:25.803302 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-3f501637-ea91-47aa-947e-02d3fb3fae7d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:25.806068 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-3f501637-ea91-47aa-947e-02d3fb3fae7d admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/1e5342bd-b47c-44f0-b22d-afadaba29bdf HTTP/1.1" status: 204  len: 168 time: 0.2507842
May 31 16:22:25.831816 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Pushing event updated for resources: {'Port': ['ID=ed28e094-e3fd-4150-b73d-a9ce8dff7be4,revision_number=3']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:25.842919 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.382s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:25.856390 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-66268e5c-453c-4535-8cab-e520085b8c24 req-249c73b0-57a7-4058-9ad1-fa21c65314d2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2781982
May 31 16:22:25.885359 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d93e1c1a-9dba-4c49-9de9-a5430c640107 req-e7700189-e7f7-4085-a479-061ce6d1cca1 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2087007
May 31 16:22:25.899113 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-3327bf9c-885e-4e31-a7b0-ab890653a077 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:22:25.911931 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-3327bf9c-885e-4e31-a7b0-ab890653a077 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Usage tracker for resource:port and tenant:8e66b29e29094a429643e0308704753b is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:22:25.918056 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-3327bf9c-885e-4e31-a7b0-ab890653a077 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Quota usage for port was recalculated. Used quota:2. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:22:25.930917 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-3327bf9c-885e-4e31-a7b0-ab890653a077 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:22:25.958635 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-3327bf9c-885e-4e31-a7b0-ab890653a077 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Made reservation on behalf of 8e66b29e29094a429643e0308704753b for: {'port': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:22:25.963430 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-3327bf9c-885e-4e31-a7b0-ab890653a077 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:26.022753 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-933fe323-810c-425b-9734-e9753b38f6ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:26.025735 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-933fe323-810c-425b-9734-e9753b38f6ae service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=0eb6e65b3f844417816fb1e5c88a8004&device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 1096 time: 0.3478298
May 31 16:22:26.158096 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:22:26.197985 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:22:26.226805 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ad72594c-f4d0-4b6f-97eb-1adc64aae7d4 req-9ffe54df-b06e-4f4f-bb20-9b78e9ba1851 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 210 time: 0.1437759
May 31 16:22:26.229827 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-346477f1-e28a-4f16-b348-c87da3790da8 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ed28e094-e3fd-4150-b73d-a9ce8dff7be4 HTTP/1.1" status: 200  len: 217 time: 0.1453991
May 31 16:22:26.436625 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning for port 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:22:26.464780 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:22:26.465447 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:26.552890 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-3327bf9c-885e-4e31-a7b0-ab890653a077 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Allocated IP 172.20.0.5 (e3df5118-0a40-4a66-b31c-a978a0c899cf/1a675b0f-478f-47e0-acdd-51bacffe39b6/747cd83a-69bc-48d9-8ba9-e9638b7be825) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:22:26.614128 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60816) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:26.652616 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ddc745b1-b9d0-4854-b917-8400057e269b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:26.675310 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-ddc745b1-b9d0-4854-b917-8400057e269b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:22:26.679206 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:22:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1acac2bb-1ccf-4a0a-92ec-37fc00c41a0d x-openstack-request-id: req-1acac2bb-1ccf-4a0a-92ec-37fc00c41a0d {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:22:26.679527 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "69990510-6c38-4988-a0ec-18ae79233830", "tag": "ed28e094-e3fd-4150-b73d-a9ce8dff7be4", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:22:26.680017 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-1acac2bb-1ccf-4a0a-92ec-37fc00c41a0d {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:22:26.680967 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-ddc745b1-b9d0-4854-b917-8400057e269b admin admin] Usage tracker for resource:security_group_rule and tenant:f2ae118912044369894d0cccd22c0213 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:22:26.681636 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '69990510-6c38-4988-a0ec-18ae79233830', 'tag': 'ed28e094-e3fd-4150-b73d-a9ce8dff7be4', 'status': 'completed', 'code': 200}
May 31 16:22:26.685118 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-ddc745b1-b9d0-4854-b917-8400057e269b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:22:26.693836 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-ddc745b1-b9d0-4854-b917-8400057e269b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:22:26.742359 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:26.776381 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e3cebd9-6320-4880-b4c6-3870437eaca8 req-4f0c71c0-499f-4af9-ab80-3e0cfdb31088 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:26.787258 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1e3cebd9-6320-4880-b4c6-3870437eaca8 req-4f0c71c0-499f-4af9-ab80-3e0cfdb31088 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 944 time: 0.3436029
May 31 16:22:26.794771 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '643ad40e-ebf7-432d-ae76-1ce2164e9eec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:22:26.800745 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-67920afa-be89-44d9-8573-881f13c59add" -d '{"events": [{"server_uuid": "643ad40e-ebf7-432d-ae76-1ce2164e9eec", "name": "network-vif-plugged", "status": "completed", "tag": "95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:22:26.826985 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b,segment=NetworkSegment(fb1fd409-498f-4f29-82bc-1d244a7a3ed1),segment_id=fb1fd409-498f-4f29-82bc-1d244a7a3ed1)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:22:26.834661 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:26.837012 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:26.951315 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ddc745b1-b9d0-4854-b917-8400057e269b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:26.965389 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ddc745b1-b9d0-4854-b917-8400057e269b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:27.006480 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:27.021045 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:27.024383 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-2fd7ea96-40f5-4958-aad2-4e015539bcd9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:27.046752 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-ddc745b1-b9d0-4854-b917-8400057e269b admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=f2ae118912044369894d0cccd22c0213&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4281943
May 31 16:22:27.050747 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60828) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:27.075194 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1e3cebd9-6320-4880-b4c6-3870437eaca8 req-8a40b409-68d6-4a96-a8e3-6089d0a1a0dd tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2539878
May 31 16:22:27.141155 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddc745b1-b9d0-4854-b917-8400057e269b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=529e3030-5169-400e-b2e0-7939484e838b,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:27.145717 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-ddc745b1-b9d0-4854-b917-8400057e269b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:27.169802 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:22:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e8fd8ed1-3469-4f0a-aa90-4a5af74c131d x-openstack-request-id: req-e8fd8ed1-3469-4f0a-aa90-4a5af74c131d {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:22:27.170880 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "643ad40e-ebf7-432d-ae76-1ce2164e9eec", "name": "network-vif-plugged", "status": "completed", "tag": "95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:22:27.170880 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-e8fd8ed1-3469-4f0a-aa90-4a5af74c131d {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:22:27.170880 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '643ad40e-ebf7-432d-ae76-1ce2164e9eec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b', 'code': 200}
May 31 16:22:27.247508 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-bd88745a-be22-4e4a-b501-67c92717cb2d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:27.281634 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-3327bf9c-885e-4e31-a7b0-ab890653a077 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:27.302705 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.provisioning_blocks [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-3327bf9c-885e-4e31-a7b0-ab890653a077 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Transition to ACTIVE for port object 747cd83a-69bc-48d9-8ba9-e9638b7be825 will not be triggered until provisioned by entity DHCP. {{(pid=91764) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:22:27.338501 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-bd88745a-be22-4e4a-b501-67c92717cb2d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:27.340854 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07997756-e177-4ad5-9030-dba15acfe530 req-3bf21588-33e8-429c-8a83-c11392e7d595 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:27.349544 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-07997756-e177-4ad5-9030-dba15acfe530 req-3bf21588-33e8-429c-8a83-c11392e7d595 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.3747408
May 31 16:22:27.464779 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-bd88745a-be22-4e4a-b501-67c92717cb2d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:27.469130 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-0b59cb61-9987-453f-993e-42b6238dc7f9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:27.494408 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd88745a-be22-4e4a-b501-67c92717cb2d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=529e3030-5169-400e-b2e0-7939484e838b,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:27.501742 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-bd88745a-be22-4e4a-b501-67c92717cb2d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:27.503652 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-bd88745a-be22-4e4a-b501-67c92717cb2d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:27.505395 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-bd88745a-be22-4e4a-b501-67c92717cb2d admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/529e3030-5169-400e-b2e0-7939484e838b HTTP/1.1" status: 204  len: 168 time: 0.4511662
May 31 16:22:27.561217 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-3327bf9c-885e-4e31-a7b0-ab890653a077 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:27.579242 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:27.688037 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-3327bf9c-885e-4e31-a7b0-ab890653a077 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Network e3df5118-0a40-4a66-b31c-a978a0c899cf is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:22:27.698832 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-3327bf9c-885e-4e31-a7b0-ab890653a077 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:22:27.704408 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3327bf9c-885e-4e31-a7b0-ab890653a077 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Pushing event updated for resources: {'Port': ['ID=747cd83a-69bc-48d9-8ba9-e9638b7be825,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:27.713793 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-3327bf9c-885e-4e31-a7b0-ab890653a077 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:22:27.754683 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-07997756-e177-4ad5-9030-dba15acfe530 req-e2c9d208-0c96-41b2-95ca-125c28f53e09 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4039538
May 31 16:22:27.759927 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-3327bf9c-885e-4e31-a7b0-ab890653a077 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.180s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:27.844910 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c4608a7-ff8e-49df-ba53-2ae7039aabeb req-bdfa8af3-cfb6-47ee-af07-524655c7ef6d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:27.854273 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8c4608a7-ff8e-49df-ba53-2ae7039aabeb req-bdfa8af3-cfb6-47ee-af07-524655c7ef6d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.5236709
May 31 16:22:27.921223 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-3327bf9c-885e-4e31-a7b0-ab890653a077 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:27.922046 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-3327bf9c-885e-4e31-a7b0-ab890653a077 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:27.970185 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-3327bf9c-885e-4e31-a7b0-ab890653a077 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.63 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.4782822
May 31 16:22:28.035298 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8c4608a7-ff8e-49df-ba53-2ae7039aabeb req-a8b80ec1-d51c-444d-8185-983998330408 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1788878
May 31 16:22:28.095352 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-92a022cb-c506-4234-9bb5-37b26b232a77 None None] Provisioning for port 747cd83a-69bc-48d9-8ba9-e9638b7be825 completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:22:28.105990 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-92a022cb-c506-4234-9bb5-37b26b232a77 None None] Provisioning complete for port 747cd83a-69bc-48d9-8ba9-e9638b7be825 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:22:28.106586 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-92a022cb-c506-4234-9bb5-37b26b232a77 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:28.144596 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-085940d8-a441-4cd1-9381-c3a30e9f04ea req-46147318-8247-47a8-989a-91ae2f6c4a38 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:28.163169 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-085940d8-a441-4cd1-9381-c3a30e9f04ea req-46147318-8247-47a8-989a-91ae2f6c4a38 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.1934605
May 31 16:22:28.196112 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60842) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:28.230284 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-cf155fda-378a-47e6-8d71-f7faee6a2880 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:28.254506 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-cf155fda-378a-47e6-8d71-f7faee6a2880 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:22:28.256393 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-92a022cb-c506-4234-9bb5-37b26b232a77 None None] Port 747cd83a-69bc-48d9-8ba9-e9638b7be825 cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:22:28.264508 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-cf155fda-378a-47e6-8d71-f7faee6a2880 admin admin] Usage tracker for resource:security_group_rule and tenant:3ed6b065e4444a2dab75aafe7d9c5a51 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:22:28.266182 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-085940d8-a441-4cd1-9381-c3a30e9f04ea req-2fca2cae-e851-4d34-9353-74a84e24d564 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1014004
May 31 16:22:28.271226 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-cf155fda-378a-47e6-8d71-f7faee6a2880 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:22:28.284791 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-cf155fda-378a-47e6-8d71-f7faee6a2880 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:22:28.386599 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-783c89c8-30e1-4a8f-9068-e08d92ffa70d req-86a21700-b055-4e5e-a6ad-0208a599c356 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:28.387607 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-783c89c8-30e1-4a8f-9068-e08d92ffa70d req-86a21700-b055-4e5e-a6ad-0208a599c356 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Synchronizing usage tracker for tenant:8e66b29e29094a429643e0308704753b on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:22:28.426023 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-783c89c8-30e1-4a8f-9068-e08d92ffa70d req-86a21700-b055-4e5e-a6ad-0208a599c356 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Unset dirty status for tenant:8e66b29e29094a429643e0308704753b on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:22:28.427976 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-783c89c8-30e1-4a8f-9068-e08d92ffa70d req-86a21700-b055-4e5e-a6ad-0208a599c356 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 931 time: 0.1601052
May 31 16:22:28.476820 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-cf155fda-378a-47e6-8d71-f7faee6a2880 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:28.484468 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-cf155fda-378a-47e6-8d71-f7faee6a2880 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:28.499561 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:28.563046 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-cf155fda-378a-47e6-8d71-f7faee6a2880 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=3ed6b065e4444a2dab75aafe7d9c5a51&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3657544
May 31 16:22:28.563971 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60848) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:28.568465 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf155fda-378a-47e6-8d71-f7faee6a2880 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a1d38b2-9cf0-4095-b396-6b718920f60e,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:28.573014 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-cf155fda-378a-47e6-8d71-f7faee6a2880 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:28.629643 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-783c89c8-30e1-4a8f-9068-e08d92ffa70d req-c6165a5b-cb2f-439f-b2fc-c29597c796f9 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1895294
May 31 16:22:28.664398 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-95c287b8-5952-48e0-983d-34f87a3f8084 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:28.718003 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-95c287b8-5952-48e0-983d-34f87a3f8084 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:28.722066 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f62f142-e65a-4536-b2ec-29fca7ea116d req-9ad23ee7-873a-49c9-8c19-261033ae9222 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:28.732812 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0f62f142-e65a-4536-b2ec-29fca7ea116d req-9ad23ee7-873a-49c9-8c19-261033ae9222 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 945 time: 0.1829424
May 31 16:22:28.806405 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0f62f142-e65a-4536-b2ec-29fca7ea116d req-491f87b8-c37e-4df1-9dc6-7dd679f23b9b tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0714974
May 31 16:22:28.854648 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-95c287b8-5952-48e0-983d-34f87a3f8084 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:28.859928 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-61d1f40a-0fb0-4950-988d-6546b88c9b54 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:28.876819 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95c287b8-5952-48e0-983d-34f87a3f8084 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a1d38b2-9cf0-4095-b396-6b718920f60e,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:28.893420 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-95c287b8-5952-48e0-983d-34f87a3f8084 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:28.897126 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-95c287b8-5952-48e0-983d-34f87a3f8084 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:28.901604 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-95c287b8-5952-48e0-983d-34f87a3f8084 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/9a1d38b2-9cf0-4095-b396-6b718920f60e HTTP/1.1" status: 204  len: 168 time: 0.3324068
May 31 16:22:29.185201 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80a214aa-cb90-4d6f-995e-5331c5ea9fea req-9291c291-80b9-4b38-a06b-7b716b0c84a3 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:29.193418 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-80a214aa-cb90-4d6f-995e-5331c5ea9fea req-9291c291-80b9-4b38-a06b-7b716b0c84a3 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.1692553
May 31 16:22:29.287056 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-80a214aa-cb90-4d6f-995e-5331c5ea9fea req-b4fc8b21-59cd-4a9b-b934-a4961199b0b7 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0917368
May 31 16:22:29.563764 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-806a0946-bfdc-4d45-88a2-bf99f131e595 req-b68c2d0b-2ba0-405c-94a4-680fb41beee5 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:29.566136 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-806a0946-bfdc-4d45-88a2-bf99f131e595 req-b68c2d0b-2ba0-405c-94a4-680fb41beee5 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.2474005
May 31 16:22:29.624637 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-553525c5-5fc1-4069-9ada-6f1164792e2f req-80b842ef-6ec6-45a3-8f00-096955fbf83a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:29.626607 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-553525c5-5fc1-4069-9ada-6f1164792e2f req-80b842ef-6ec6-45a3-8f00-096955fbf83a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.2048693
May 31 16:22:29.683737 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-806a0946-bfdc-4d45-88a2-bf99f131e595 req-02c4ad11-a4d9-4e1c-8e7f-37addaf99be3 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1108451
May 31 16:22:29.734289 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-553525c5-5fc1-4069-9ada-6f1164792e2f req-fece2efc-c879-4d02-a971-c7f8d9c125eb tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0847421
May 31 16:22:30.088088 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24fde6b7-31b0-4c6d-90c3-62539c4ea8a4 req-6475b424-6768-4bcd-827d-4962baacccd4 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:30.089864 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-24fde6b7-31b0-4c6d-90c3-62539c4ea8a4 req-6475b424-6768-4bcd-827d-4962baacccd4 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 931 time: 0.2322176
May 31 16:22:30.104761 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dab62295-3877-4d86-8822-811d16763652 req-3d6c4eca-625a-42e1-b229-4a8c93e7e620 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:30.113601 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-dab62295-3877-4d86-8822-811d16763652 req-3d6c4eca-625a-42e1-b229-4a8c93e7e620 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 945 time: 0.1578093
May 31 16:22:30.195921 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-24fde6b7-31b0-4c6d-90c3-62539c4ea8a4 req-9c135fed-ae9b-4495-be14-9a5156e5bb2b tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0793808
May 31 16:22:30.208714 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-dab62295-3877-4d86-8822-811d16763652 req-7eae018d-e45e-4af5-819b-89c1fc1e652e tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0914917
May 31 16:22:30.581735 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-200cb28b-b25a-4490-afd3-b1206cf4cd7e req-8ebefb0f-afe1-4b9a-a54c-46bdc0b6946b tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:30.586758 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-200cb28b-b25a-4490-afd3-b1206cf4cd7e req-8ebefb0f-afe1-4b9a-a54c-46bdc0b6946b tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.1627238
May 31 16:22:30.678708 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-200cb28b-b25a-4490-afd3-b1206cf4cd7e req-a2eeae7c-1324-409a-9b25-29b52dbfe6bd tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0832620
May 31 16:22:31.165082 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-203416bb-6411-4c44-879f-012575b389a2 req-8f5db42a-6424-4386-9c67-528b62b0b95c tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:31.171727 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-203416bb-6411-4c44-879f-012575b389a2 req-8f5db42a-6424-4386-9c67-528b62b0b95c tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.1982164
May 31 16:22:31.205222 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0aafc85-bad0-45d1-91ef-126cfa02fea8 req-6bc555f9-4fb1-414f-a239-959c267c8318 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:31.211671 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d0aafc85-bad0-45d1-91ef-126cfa02fea8 req-6bc555f9-4fb1-414f-a239-959c267c8318 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.3231151
May 31 16:22:31.335297 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-203416bb-6411-4c44-879f-012575b389a2 req-c9510f35-d6b7-4b8e-8343-ea03b172a001 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1524484
May 31 16:22:31.353312 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d0aafc85-bad0-45d1-91ef-126cfa02fea8 req-cc4471c7-cea2-4ddf-9d46-0aeaf33e0026 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1025987
May 31 16:22:31.470245 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60926) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:31.673361 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef6b9f75-3080-4ae7-996e-87ffc7e91100 req-dad08330-f5c8-4ed0-a9ea-0b13fdf8ba9b tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:31.675491 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ef6b9f75-3080-4ae7-996e-87ffc7e91100 req-dad08330-f5c8-4ed0-a9ea-0b13fdf8ba9b tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 945 time: 0.2102132
May 31 16:22:31.689750 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c128321a-3ece-4619-9fbd-3e5b59ccfd5d req-2a7b44c7-794a-4089-8e8c-d80aca8dd9c7 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:31.692147 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c128321a-3ece-4619-9fbd-3e5b59ccfd5d req-2a7b44c7-794a-4089-8e8c-d80aca8dd9c7 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 931 time: 0.1494370
May 31 16:22:31.719504 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8ad976b1-f8e2-4d7d-9286-014058da95d2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:31.748179 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-8ad976b1-f8e2-4d7d-9286-014058da95d2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:22:31.760126 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-8ad976b1-f8e2-4d7d-9286-014058da95d2 admin admin] Usage tracker for resource:security_group_rule and tenant:eb9a85a367bd436597b602524e94213f is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:22:31.764667 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-8ad976b1-f8e2-4d7d-9286-014058da95d2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:22:31.772342 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-8ad976b1-f8e2-4d7d-9286-014058da95d2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:22:31.786149 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ef6b9f75-3080-4ae7-996e-87ffc7e91100 req-9c1c91ea-5441-4874-ba11-cfbc351356f0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1042762
May 31 16:22:31.791660 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c128321a-3ece-4619-9fbd-3e5b59ccfd5d req-c3bcda1a-5247-4817-b8e0-6b406d62a909 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0861793
May 31 16:22:31.931006 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8ad976b1-f8e2-4d7d-9286-014058da95d2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:31.937341 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8ad976b1-f8e2-4d7d-9286-014058da95d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:31.952917 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-ddc745b1-b9d0-4854-b917-8400057e269b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:32.007100 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-8ad976b1-f8e2-4d7d-9286-014058da95d2 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=eb9a85a367bd436597b602524e94213f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5232167
May 31 16:22:32.011560 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60934) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:32.014596 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c28f60c-84e8-4e89-b51d-2a7fae4863ee req-7f2eb3f3-e797-4662-a8f3-7df5bd8ce17c tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:32.016162 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7c28f60c-84e8-4e89-b51d-2a7fae4863ee req-7f2eb3f3-e797-4662-a8f3-7df5bd8ce17c tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.1176302
May 31 16:22:32.017049 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ad976b1-f8e2-4d7d-9286-014058da95d2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e2376225-d580-42ff-9906-d96305199fa9,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:32.022379 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-8ad976b1-f8e2-4d7d-9286-014058da95d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:32.083531 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7c28f60c-84e8-4e89-b51d-2a7fae4863ee req-34ccf669-7288-4062-814b-e16e678d450b tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0573223
May 31 16:22:32.118429 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6e4a5dc0-ff51-42d3-8c5a-ab00a9318ac3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:32.159308 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6e4a5dc0-ff51-42d3-8c5a-ab00a9318ac3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:32.234061 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6e4a5dc0-ff51-42d3-8c5a-ab00a9318ac3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:32.239120 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-982f423b-90db-4de9-8e8c-b69f0c4850e1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:32.250838 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e4a5dc0-ff51-42d3-8c5a-ab00a9318ac3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e2376225-d580-42ff-9906-d96305199fa9,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:32.256231 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-6e4a5dc0-ff51-42d3-8c5a-ab00a9318ac3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:32.259884 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6e4a5dc0-ff51-42d3-8c5a-ab00a9318ac3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:32.261305 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-6e4a5dc0-ff51-42d3-8c5a-ab00a9318ac3 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/e2376225-d580-42ff-9906-d96305199fa9 HTTP/1.1" status: 204  len: 168 time: 0.2487967
May 31 16:22:32.922544 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d6cc567-6b31-4b36-bfd3-a3d8900b0e95 req-161cfedb-192a-4657-a10c-619a5b431b5c tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:32.935340 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6d6cc567-6b31-4b36-bfd3-a3d8900b0e95 req-161cfedb-192a-4657-a10c-619a5b431b5c tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.4384863
May 31 16:22:32.957856 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60958) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:32.984921 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-f220a1f4-061d-46ab-b4ae-e0afa18f8962 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:32.996775 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da71c742-edf1-4097-812d-2fab3d1a3b51 req-f160daa6-2773-40ec-bfcb-f6be1f8f0df9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:33.005214 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-da71c742-edf1-4097-812d-2fab3d1a3b51 req-f160daa6-2773-40ec-bfcb-f6be1f8f0df9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.2520936
May 31 16:22:33.011067 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-f220a1f4-061d-46ab-b4ae-e0afa18f8962 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:22:33.016887 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-f220a1f4-061d-46ab-b4ae-e0afa18f8962 admin admin] Usage tracker for resource:security_group_rule and tenant:ffef02c2a20249f8947cdb2446e4f24a is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:22:33.022290 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-f220a1f4-061d-46ab-b4ae-e0afa18f8962 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:22:33.032115 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-f220a1f4-061d-46ab-b4ae-e0afa18f8962 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:22:33.071323 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6d6cc567-6b31-4b36-bfd3-a3d8900b0e95 req-e6be840a-dceb-41d8-a1f0-f9d82e857c1e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1327302
May 31 16:22:33.129255 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-da71c742-edf1-4097-812d-2fab3d1a3b51 req-ed00429c-2ed4-4435-931f-c9393ab699ce tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1227245
May 31 16:22:33.163900 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-f220a1f4-061d-46ab-b4ae-e0afa18f8962 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:33.189684 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-f220a1f4-061d-46ab-b4ae-e0afa18f8962 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:33.226987 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-75f1dcd7-37b7-461a-b62e-1df30283070f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:33.316391 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-f220a1f4-061d-46ab-b4ae-e0afa18f8962 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=ffef02c2a20249f8947cdb2446e4f24a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3539221
May 31 16:22:33.316391 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f220a1f4-061d-46ab-b4ae-e0afa18f8962 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=41521b6b-1ec7-4101-af34-4370c9325569,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:33.318583 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 60964) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:33.342421 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-f220a1f4-061d-46ab-b4ae-e0afa18f8962 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:33.409713 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8a76f1fb-1872-4e69-b9be-a9c260889dc6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:33.452129 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8a76f1fb-1872-4e69-b9be-a9c260889dc6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:33.453226 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c56a152-74af-4576-99f3-46e5aa259c47 req-2569cc41-53d4-40aa-9338-74fe2da1ffb6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:33.454981 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0c56a152-74af-4576-99f3-46e5aa259c47 req-2569cc41-53d4-40aa-9338-74fe2da1ffb6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 945 time: 0.1808448
May 31 16:22:33.469674 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3031e43e-8de8-43a6-b6a6-0a2507132e70 req-c93dedec-041e-4212-bfdf-868fa94ad601 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:33.472186 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3031e43e-8de8-43a6-b6a6-0a2507132e70 req-c93dedec-041e-4212-bfdf-868fa94ad601 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 931 time: 0.1570477
May 31 16:22:33.535294 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8a76f1fb-1872-4e69-b9be-a9c260889dc6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:33.541448 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d4fcd463-a7b4-4a52-bab9-a428bbccb2a8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:33.558570 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a76f1fb-1872-4e69-b9be-a9c260889dc6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=41521b6b-1ec7-4101-af34-4370c9325569,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:33.560576 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0c56a152-74af-4576-99f3-46e5aa259c47 req-3e909db9-bae8-46fa-81a6-1f5e5b590e86 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0871687
May 31 16:22:33.566592 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-8a76f1fb-1872-4e69-b9be-a9c260889dc6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:33.575168 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3031e43e-8de8-43a6-b6a6-0a2507132e70 req-6799bfe8-3860-4295-80cf-b0f04967027b tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0789921
May 31 16:22:33.575269 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8a76f1fb-1872-4e69-b9be-a9c260889dc6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:33.575269 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-8a76f1fb-1872-4e69-b9be-a9c260889dc6 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/41521b6b-1ec7-4101-af34-4370c9325569 HTTP/1.1" status: 204  len: 168 time: 0.2542224
May 31 16:22:33.831620 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c7e01c2-c577-4170-834a-508ef0748b65 req-ce5d1dc8-3389-4482-a68b-93d0f5e0b950 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:33.833669 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3c7e01c2-c577-4170-834a-508ef0748b65 req-ce5d1dc8-3389-4482-a68b-93d0f5e0b950 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.1360579
May 31 16:22:33.903795 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3c7e01c2-c577-4170-834a-508ef0748b65 req-7843c2d7-d111-45ac-93f0-b601ab7bd16a tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0632987
May 31 16:22:34.559745 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fee97b3-eee9-43dc-ac11-80e68539f207 req-0047b477-b855-4bd5-a03e-7408010bc311 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:34.568132 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3fee97b3-eee9-43dc-ac11-80e68539f207 req-0047b477-b855-4bd5-a03e-7408010bc311 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.2957864
May 31 16:22:34.614530 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cb73f3e-c977-4ecb-8d06-3996e843d354 req-dbb91eca-0813-4cf7-915d-537a720f8030 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:34.628862 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5cb73f3e-c977-4ecb-8d06-3996e843d354 req-dbb91eca-0813-4cf7-915d-537a720f8030 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.3054500
May 31 16:22:34.709323 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3fee97b3-eee9-43dc-ac11-80e68539f207 req-ea7aa1e9-63f4-4d20-9af2-d175658188be tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1381767
May 31 16:22:34.761330 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5cb73f3e-c977-4ecb-8d06-3996e843d354 req-d8b4a471-445d-46e0-baf2-27a14931c963 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1344168
May 31 16:22:35.023470 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-689cd2e3-0213-4cb8-8676-d75e8358ce72 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:35.048540 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 32776) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:35.157981 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8588b0e4-3e54-4c18-99cb-119a8c3526b9 req-b093881c-e980-40c7-ac01-0e20ae69ac1f tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:35.160227 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8588b0e4-3e54-4c18-99cb-119a8c3526b9 req-b093881c-e980-40c7-ac01-0e20ae69ac1f tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 931 time: 0.1652279
May 31 16:22:35.172783 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c419979d-b67d-402c-8591-c3acf060aa26 req-98653981-7617-4f68-82d5-451887509ea5 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:35.186064 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c419979d-b67d-402c-8591-c3acf060aa26 req-98653981-7617-4f68-82d5-451887509ea5 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 945 time: 0.2641730
May 31 16:22:35.317619 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c419979d-b67d-402c-8591-c3acf060aa26 req-ac7d1058-f8cd-45c3-9598-504ed876b294 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1282399
May 31 16:22:35.370941 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8588b0e4-3e54-4c18-99cb-119a8c3526b9 req-db3cc069-d9f5-419d-b86a-8cb8eedcbff7 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1803436
May 31 16:22:35.529989 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e94f9991-95e4-4691-ae00-d744648a3a2f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:35.556064 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-e94f9991-95e4-4691-ae00-d744648a3a2f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:22:35.561009 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-e94f9991-95e4-4691-ae00-d744648a3a2f admin admin] Usage tracker for resource:security_group_rule and tenant:3ae5800a4aec402a811f991d0a894473 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:22:35.565304 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-e94f9991-95e4-4691-ae00-d744648a3a2f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:22:35.573811 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-e94f9991-95e4-4691-ae00-d744648a3a2f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:22:35.600293 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-092a6f7a-229a-4c71-8d1d-ee0773910f49 req-0402726e-50dd-4d9f-bb15-fe42f09bd274 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:35.601993 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-092a6f7a-229a-4c71-8d1d-ee0773910f49 req-0402726e-50dd-4d9f-bb15-fe42f09bd274 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.1226325
May 31 16:22:35.680979 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-092a6f7a-229a-4c71-8d1d-ee0773910f49 req-82fe35c8-71b3-4fa3-a3c5-a045cb0a6b14 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0686898
May 31 16:22:35.724446 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e94f9991-95e4-4691-ae00-d744648a3a2f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:35.729465 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e94f9991-95e4-4691-ae00-d744648a3a2f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:35.739056 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-052f7a5b-78b4-4ccc-a626-ab0b40958bfb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:35.775015 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e94f9991-95e4-4691-ae00-d744648a3a2f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=abec425c-5ac2-42ba-a968-eb0b6b1ec2f9,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:35.780308 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e94f9991-95e4-4691-ae00-d744648a3a2f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:35.802610 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-e94f9991-95e4-4691-ae00-d744648a3a2f admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=3ae5800a4aec402a811f991d0a894473&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7507272
May 31 16:22:35.805398 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 32792) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:36.040417 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3c319847-b586-415f-a19d-111a302c1e43 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:36.103492 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3c319847-b586-415f-a19d-111a302c1e43 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:36.151180 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ee19835-6e5f-47b6-8b4e-e04292181819 req-3477f0e7-5281-4f8b-8e09-bed12c37a1bc tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:36.161070 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6ee19835-6e5f-47b6-8b4e-e04292181819 req-3477f0e7-5281-4f8b-8e09-bed12c37a1bc tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.2976050
May 31 16:22:36.249750 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9675c5c3-81b1-4cd6-8dff-997d4e20f50d req-371f1386-6ee2-49e9-8183-31d36f800243 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:36.252547 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9675c5c3-81b1-4cd6-8dff-997d4e20f50d req-371f1386-6ee2-49e9-8183-31d36f800243 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.3051317
May 31 16:22:36.301952 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6ee19835-6e5f-47b6-8b4e-e04292181819 req-3309dc47-8e90-43c2-a498-3bac5d345fc3 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1295400
May 31 16:22:36.317035 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3c319847-b586-415f-a19d-111a302c1e43 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:36.325716 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-63bfc35c-63f7-4089-bbd7-516401ac8d6f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:36.350642 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9675c5c3-81b1-4cd6-8dff-997d4e20f50d req-d2e2ee26-57e7-478d-ae0e-03badb2de9c2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0852516
May 31 16:22:36.355410 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c319847-b586-415f-a19d-111a302c1e43 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=abec425c-5ac2-42ba-a968-eb0b6b1ec2f9,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:36.379347 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-3c319847-b586-415f-a19d-111a302c1e43 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:36.379347 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3c319847-b586-415f-a19d-111a302c1e43 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:36.379347 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-3c319847-b586-415f-a19d-111a302c1e43 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/abec425c-5ac2-42ba-a968-eb0b6b1ec2f9 HTTP/1.1" status: 204  len: 168 time: 0.5701504
May 31 16:22:36.709268 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-354fbcaa-84c7-4a41-b18c-f6dd3c22a8f4 req-2bb60c45-d893-4bd7-bac6-e57d2b8dcefd tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:36.726210 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-354fbcaa-84c7-4a41-b18c-f6dd3c22a8f4 req-2bb60c45-d893-4bd7-bac6-e57d2b8dcefd tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 931 time: 0.1978211
May 31 16:22:36.827681 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d04d5ab1-2014-488c-a12d-f91598f04cff req-ce4e23a5-5425-4c7f-b66f-8f3db338e72b tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:36.840688 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d04d5ab1-2014-488c-a12d-f91598f04cff req-ce4e23a5-5425-4c7f-b66f-8f3db338e72b tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 945 time: 0.2677085
May 31 16:22:36.906906 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-354fbcaa-84c7-4a41-b18c-f6dd3c22a8f4 req-c9d95997-999a-4ff7-ae6d-680fde36eeb9 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1797099
May 31 16:22:36.970914 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d04d5ab1-2014-488c-a12d-f91598f04cff req-47c15de1-414e-4420-9ed6-427533dc13b2 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1154151
May 31 16:22:37.192167 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6ec86ce-e069-4ce4-8b47-2d7cd1beb32a req-a3a66fa9-2c70-46ca-83b1-7792109ac083 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:37.194063 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d6ec86ce-e069-4ce4-8b47-2d7cd1beb32a req-a3a66fa9-2c70-46ca-83b1-7792109ac083 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.1053064
May 31 16:22:37.297559 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d6ec86ce-e069-4ce4-8b47-2d7cd1beb32a req-02b6ed65-50ce-44c7-829c-79148293ed20 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0974932
May 31 16:22:37.462128 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 32846) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:37.825878 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c29fb5cf-adfe-4f7a-b652-caddafd9823a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:37.844636 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-c29fb5cf-adfe-4f7a-b652-caddafd9823a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:22:37.855372 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-c29fb5cf-adfe-4f7a-b652-caddafd9823a admin admin] Usage tracker for resource:security_group_rule and tenant:1275f0f0a4eb4223be7b1a7d315c5a39 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:22:37.861233 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-c29fb5cf-adfe-4f7a-b652-caddafd9823a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:22:37.869962 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-c29fb5cf-adfe-4f7a-b652-caddafd9823a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:22:37.883629 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a212563-8172-4579-928a-1c57cd8178b0 req-6cb02078-f476-4e60-b4d6-83540d37c462 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:37.886168 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0a212563-8172-4579-928a-1c57cd8178b0 req-6cb02078-f476-4e60-b4d6-83540d37c462 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.3887367
May 31 16:22:37.895816 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:37.902816 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5875322-8f47-4023-856c-3697831b861e req-7798c608-025a-46f5-8db5-f219913bb725 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:37.904329 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a5875322-8f47-4023-856c-3697831b861e req-7798c608-025a-46f5-8db5-f219913bb725 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.3464167
May 31 16:22:38.052044 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0a212563-8172-4579-928a-1c57cd8178b0 req-6b24b72f-15d0-40c6-822e-8b634deaa29a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1445618
May 31 16:22:38.083678 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a5875322-8f47-4023-856c-3697831b861e req-5d14b56b-4d1e-4b21-9abf-01705bf7412f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1563427
May 31 16:22:38.246841 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b6b666b-db00-4ba1-a59d-43ad95d37c66 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:38.306919 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c29fb5cf-adfe-4f7a-b652-caddafd9823a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:38.334042 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c29fb5cf-adfe-4f7a-b652-caddafd9823a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:38.363992 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-cda6d9a3-74c9-437a-8cec-b84bcedf15c7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:38.385622 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7213a86f-633b-4be5-a963-f5642857a3e5 req-fe92aa7d-4d4e-4baa-bdec-dc170ad047ab tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:38.387178 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7213a86f-633b-4be5-a963-f5642857a3e5 req-fe92aa7d-4d4e-4baa-bdec-dc170ad047ab tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 931 time: 0.1718247
May 31 16:22:38.506301 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-c29fb5cf-adfe-4f7a-b652-caddafd9823a admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=1275f0f0a4eb4223be7b1a7d315c5a39&name=default HTTP/1.1" status: 200  len: 2979 time: 1.0424929
May 31 16:22:38.510041 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 32874) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:38.525044 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c29fb5cf-adfe-4f7a-b652-caddafd9823a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=26f0e606-1869-4b5b-af6a-99f37d73f3cd,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:38.532130 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c29fb5cf-adfe-4f7a-b652-caddafd9823a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:38.554332 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7213a86f-633b-4be5-a963-f5642857a3e5 req-49bd2f67-f434-4eaf-af3e-c7b69f683a34 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1239932
May 31 16:22:38.605600 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-282f0e46-2a73-4b99-9765-d21c4756dbdf req-1818cb1c-e7a4-4833-960c-d74f86112996 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:38.607433 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-282f0e46-2a73-4b99-9765-d21c4756dbdf req-1818cb1c-e7a4-4833-960c-d74f86112996 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 945 time: 0.2326744
May 31 16:22:38.629660 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-86df04ef-3d9f-4edb-973f-49c529a08d9a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:38.664834 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-86df04ef-3d9f-4edb-973f-49c529a08d9a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:38.681042 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-282f0e46-2a73-4b99-9765-d21c4756dbdf req-68ac6447-1a9f-4922-b589-b2df4c05e26e tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0664375
May 31 16:22:38.738640 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-86df04ef-3d9f-4edb-973f-49c529a08d9a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:38.742783 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-95c287b8-5952-48e0-983d-34f87a3f8084 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:38.757758 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86df04ef-3d9f-4edb-973f-49c529a08d9a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=26f0e606-1869-4b5b-af6a-99f37d73f3cd,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:38.760644 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-86df04ef-3d9f-4edb-973f-49c529a08d9a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:38.786817 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-86df04ef-3d9f-4edb-973f-49c529a08d9a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:38.788120 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-86df04ef-3d9f-4edb-973f-49c529a08d9a admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/26f0e606-1869-4b5b-af6a-99f37d73f3cd HTTP/1.1" status: 204  len: 168 time: 0.2759249
May 31 16:22:38.807384 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0711e163-add0-4472-96e1-39a43f342e13 req-5393b453-0860-43b5-933a-17fbe3da127a tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:38.808996 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0711e163-add0-4472-96e1-39a43f342e13 req-5393b453-0860-43b5-933a-17fbe3da127a tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.0984530
May 31 16:22:38.882138 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0711e163-add0-4472-96e1-39a43f342e13 req-df4aa62e-d16b-4317-80b2-19d4cc2c9288 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0638885
May 31 16:22:39.138703 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:39.202641 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 32890) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:39.222705 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ec57ec0f-73e3-49eb-a1fe-c14955a76259 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:39.239523 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-ec57ec0f-73e3-49eb-a1fe-c14955a76259 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:22:39.246771 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-ec57ec0f-73e3-49eb-a1fe-c14955a76259 admin admin] Usage tracker for resource:security_group_rule and tenant:34257b3f9760409ea8bc7aae2935a071 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:22:39.253218 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-ec57ec0f-73e3-49eb-a1fe-c14955a76259 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:22:39.264641 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-ec57ec0f-73e3-49eb-a1fe-c14955a76259 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:22:39.269700 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3e7fb8d-005c-4a1a-a749-ce1401c75f02 req-5314b626-bc22-417d-92d3-e763d0744cf1 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:39.271496 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c3e7fb8d-005c-4a1a-a749-ce1401c75f02 req-5314b626-bc22-417d-92d3-e763d0744cf1 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.1009433
May 31 16:22:39.335021 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c3e7fb8d-005c-4a1a-a749-ce1401c75f02 req-baeb0c73-826f-4723-bca0-5c94c1507db5 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0496869
May 31 16:22:39.356958 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Request body: {'port': {'device_id': '1d2436ad-b7ce-4d4c-851a-544a84fe2ef5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79381'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:22:39.403471 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ec57ec0f-73e3-49eb-a1fe-c14955a76259 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:39.408297 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ec57ec0f-73e3-49eb-a1fe-c14955a76259 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:39.418325 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-6e4a5dc0-ff51-42d3-8c5a-ab00a9318ac3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:39.499057 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-ec57ec0f-73e3-49eb-a1fe-c14955a76259 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=34257b3f9760409ea8bc7aae2935a071&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2949498
May 31 16:22:39.513949 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 32894) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:39.582139 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec57ec0f-73e3-49eb-a1fe-c14955a76259 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=60eefd38-289c-4a9f-ad4b-1817f3e2086c,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:39.590518 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-ec57ec0f-73e3-49eb-a1fe-c14955a76259 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:39.607343 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-ef0c246e-e288-4693-aaef-1c1485fcacd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:39.609024 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-ef0c246e-e288-4693-aaef-1c1485fcacd5 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=68c4d303-4299-4977-888e-57c80b8530cc HTTP/1.1" status: 200  len: 854 time: 0.2570200
May 31 16:22:39.636444 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28b4f900-3241-4611-9084-4223a8a4bcfc req-78035537-e55d-40e6-b762-f9af4264bf76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:39.638237 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-28b4f900-3241-4611-9084-4223a8a4bcfc req-78035537-e55d-40e6-b762-f9af4264bf76 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=1739d3c0e2734c8a9af5c5291aac8e25&device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 1099 time: 0.1813281
May 31 16:22:39.694654 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-eb41a071-0c3e-4378-b92d-93acfb72dd3d service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=1097eeec-06a4-406d-ab4a-02e0123072d2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0638692
May 31 16:22:39.708344 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:39.791918 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.63', 65067) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:39.839269 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28b4f900-3241-4611-9084-4223a8a4bcfc req-ec1d8613-68e0-4646-933e-33cacb86f49e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:39.840612 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-28b4f900-3241-4611-9084-4223a8a4bcfc req-ec1d8613-68e0-4646-933e-33cacb86f49e service neutron] 10.222.0.63 "GET /v2.0/networks?id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 HTTP/1.1" status: 200  len: 920 time: 0.1880708
May 31 16:22:39.914433 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a084461-15d5-4f94-8290-0b873edc3479 req-e845ad4d-6230-414f-a2ef-b36c629cdfd7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:39.915910 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0a084461-15d5-4f94-8290-0b873edc3479 req-e845ad4d-6230-414f-a2ef-b36c629cdfd7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.4801130
May 31 16:22:39.916611 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3cde4d03-ce6a-4de5-8aaf-b86d1f6a9b04 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:39.917513 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-28b4f900-3241-4611-9084-4223a8a4bcfc req-8c030682-b147-48b6-9bf1-b366d559a5a3 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=f99df66c-c850-4d01-80ae-3d312eee69db HTTP/1.1" status: 200  len: 217 time: 0.0667105
May 31 16:22:39.970882 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cf16c2e-e71d-44e5-87f6-74498a89c8f4 req-af800097-98dd-4fdb-80f3-70c6067e0b33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:39.974588 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-3cf16c2e-e71d-44e5-87f6-74498a89c8f4 req-af800097-98dd-4fdb-80f3-70c6067e0b33 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 1098 time: 0.1798403
May 31 16:22:40.013327 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28b4f900-3241-4611-9084-4223a8a4bcfc req-6f85d5b6-3ff6-4b00-a141-cd4740c5777c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:40.014950 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-28b4f900-3241-4611-9084-4223a8a4bcfc req-6f85d5b6-3ff6-4b00-a141-cd4740c5777c service neutron] 10.222.0.63 "GET /v2.0/subnets?id=b9c806fb-2a53-4445-8352-4336429eb043 HTTP/1.1" status: 200  len: 859 time: 0.0862417
May 31 16:22:40.026229 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3cde4d03-ce6a-4de5-8aaf-b86d1f6a9b04 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:40.070102 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-3cf16c2e-e71d-44e5-87f6-74498a89c8f4 req-345ea0a2-c3f9-4b6f-a4fc-716891eaf21e service neutron] Synchronizing usage tracker for tenant:6069822d9ad1473ebc837c35e08d9f89 on resource:security_group {{(pid=91763) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:22:40.075165 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-28b4f900-3241-4611-9084-4223a8a4bcfc req-c96e1a29-fd5e-4d7b-aaa4-261196b0eac9 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0480208
May 31 16:22:40.137160 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0a084461-15d5-4f94-8290-0b873edc3479 req-73c3edb8-4e46-4a23-86eb-97c3c4252900 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1964891
May 31 16:22:40.203178 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-20ba0129-2f0a-408e-ae62-f501c40ecc1e service neutron] 10.222.0.63 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4820511
May 31 16:22:40.237772 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 8cf870c7-bdf1-490f-adfa-61e27997bc91 details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:22:40.327949 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-3cf16c2e-e71d-44e5-87f6-74498a89c8f4 req-345ea0a2-c3f9-4b6f-a4fc-716891eaf21e service neutron] Unset dirty status for tenant:6069822d9ad1473ebc837c35e08d9f89 on resource:security_group {{(pid=91763) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:22:40.329390 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-3cf16c2e-e71d-44e5-87f6-74498a89c8f4 req-345ea0a2-c3f9-4b6f-a4fc-716891eaf21e service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.3453934
May 31 16:22:40.350406 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-28b4f900-3241-4611-9084-4223a8a4bcfc req-b83adf20-7f18-4a6c-bd02-842669718d4a service neutron] 10.222.0.63 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2615974
May 31 16:22:40.461924 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c9c7900-51eb-4743-8429-b4e9a6e8a4e6 req-a12fc4ff-8044-4426-b255-67ba900c46b2 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:40.462183 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 8cf870c7-bdf1-490f-adfa-61e27997bc91, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=8cf870c7-bdf1-490f-adfa-61e27997bc91,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:22:40.463561 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5c9c7900-51eb-4743-8429-b4e9a6e8a4e6 req-a12fc4ff-8044-4426-b255-67ba900c46b2 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 931 time: 0.7435977
May 31 16:22:40.485983 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': '8cf870c7-bdf1-490f-adfa-61e27997bc91', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'port_id': '8cf870c7-bdf1-490f-adfa-61e27997bc91', 'mac_address': 'fa:16:3e:b1:f3:43', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 806, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:22:40.554352 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-28b4f900-3241-4611-9084-4223a8a4bcfc req-77688855-d8da-4a2c-8143-23fcf8a30717 service neutron] 10.222.0.63 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1430433
May 31 16:22:40.569969 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:40.591064 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 8cf870c7-bdf1-490f-adfa-61e27997bc91 {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:22:40.622723 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 8cf870c7-bdf1-490f-adfa-61e27997bc91, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=8cf870c7-bdf1-490f-adfa-61e27997bc91,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:22:40.632353 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:40.635282 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-1ef1d3b2-e8c1-466e-86ad-f6726b68351a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:40.647632 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3cde4d03-ce6a-4de5-8aaf-b86d1f6a9b04 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:40.659821 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-3c319847-b586-415f-a19d-111a302c1e43 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:40.724805 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cde4d03-ce6a-4de5-8aaf-b86d1f6a9b04 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=60eefd38-289c-4a9f-ad4b-1817f3e2086c,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:40.727941 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=8cf870c7-bdf1-490f-adfa-61e27997bc91,revision_number=6']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:40.732469 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:40.735462 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-3cde4d03-ce6a-4de5-8aaf-b86d1f6a9b04 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:40.781422 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5c9c7900-51eb-4743-8429-b4e9a6e8a4e6 req-9531517d-9ca9-4fb9-b224-91f765c1ede5 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3017876
May 31 16:22:40.796576 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['8cf870c7-bdf1-490f-adfa-61e27997bc91'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:22:40.807115 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3cde4d03-ce6a-4de5-8aaf-b86d1f6a9b04 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:40.816276 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-3cde4d03-ce6a-4de5-8aaf-b86d1f6a9b04 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/60eefd38-289c-4a9f-ad4b-1817f3e2086c HTTP/1.1" status: 204  len: 168 time: 1.2937548
May 31 16:22:40.835134 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cac5046e-7a45-46e8-94d4-515dae808d6c req-1e6c9fab-968f-4915-a901-b9e8d5bc81ba service neutron] 10.222.0.63 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6145461
May 31 16:22:40.896345 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d47adf9f-29b0-4569-a4e2-5b6fdb938fbd req-8b58442c-f0fa-428b-b28f-5e866525474e tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:40.900599 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d47adf9f-29b0-4569-a4e2-5b6fdb938fbd req-8b58442c-f0fa-428b-b28f-5e866525474e tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 945 time: 0.6424248
May 31 16:22:40.962690 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:41.153298 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 747cd83a-69bc-48d9-8ba9-e9638b7be825 {{(pid=91764) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:22:41.161226 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d47adf9f-29b0-4569-a4e2-5b6fdb938fbd req-7a89d928-a316-4dd0-86c5-950bd3b3e347 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2484431
May 31 16:22:41.168936 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:41.195314 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.provisioning_blocks [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Transition to ACTIVE for port object 747cd83a-69bc-48d9-8ba9-e9638b7be825 will not be triggered until provisioned by entity L2. {{(pid=91764) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:22:41.210251 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:41.217273 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:41.285481 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbf8a899-671f-44bc-b3c7-5e7428830771 req-28716815-57ed-4b52-b13e-840965002494 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:41.286962 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cbf8a899-671f-44bc-b3c7-5e7428830771 req-28716815-57ed-4b52-b13e-840965002494 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=0eb6e65b3f844417816fb1e5c88a8004&device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 1096 time: 0.3316684
May 31 16:22:41.418647 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a8f6c4-e6e6-4527-888f-28d630f4e31f req-4b7d95dc-0682-4b4e-a570-1795f673e9ab tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:41.420109 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-51a8f6c4-e6e6-4527-888f-28d630f4e31f req-4b7d95dc-0682-4b4e-a570-1795f673e9ab tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.4677563
May 31 16:22:41.441961 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Pushing event updated for resources: {'Port': ['ID=747cd83a-69bc-48d9-8ba9-e9638b7be825,revision_number=2']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:41.508381 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.291s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:41.650182 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-51a8f6c4-e6e6-4527-888f-28d630f4e31f req-ee8b2d54-d163-4e5e-a671-2b2cd8194718 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2116053
May 31 16:22:41.730857 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40930a4c-f810-4a55-9592-c4256a4c2b5a req-d54c24f9-fa67-488e-90ab-4766860a5306 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:41.739006 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-40930a4c-f810-4a55-9592-c4256a4c2b5a req-d54c24f9-fa67-488e-90ab-4766860a5306 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.4606333
May 31 16:22:41.768698 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbf8a899-671f-44bc-b3c7-5e7428830771 req-560cd6b5-1d2f-4b77-970a-81bd29041187 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:41.770276 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cbf8a899-671f-44bc-b3c7-5e7428830771 req-560cd6b5-1d2f-4b77-970a-81bd29041187 service neutron] 10.222.0.63 "GET /v2.0/networks?id=1097eeec-06a4-406d-ab4a-02e0123072d2 HTTP/1.1" status: 200  len: 915 time: 0.4395633
May 31 16:22:41.876326 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Attempting to bind port 747cd83a-69bc-48d9-8ba9-e9638b7be825 on host hv-cinder-79381 for vnic_type normal with profile  {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:22:41.876673 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Attempting to bind port 747cd83a-69bc-48d9-8ba9-e9638b7be825 by drivers openvswitch,hyperv on host hv-cinder-79381 at level 0 using segments [{'id': '44700c9f-b523-4212-86eb-cc7308ee0431', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 808, 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf'}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:22:41.877101 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Attempting to bind port 747cd83a-69bc-48d9-8ba9-e9638b7be825 on network e3df5118-0a40-4a66-b31c-a978a0c899cf {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:22:41.902200 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cbf8a899-671f-44bc-b3c7-5e7428830771 req-4fe02567-e9c6-4a24-8345-7ab346798101 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ed28e094-e3fd-4150-b73d-a9ce8dff7be4 HTTP/1.1" status: 200  len: 217 time: 0.1234825
May 31 16:22:41.910050 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Port 747cd83a-69bc-48d9-8ba9-e9638b7be825 on network e3df5118-0a40-4a66-b31c-a978a0c899cf not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79381 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 31 16:22:41.910373 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Attempting to bind port 747cd83a-69bc-48d9-8ba9-e9638b7be825 on network e3df5118-0a40-4a66-b31c-a978a0c899cf {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:22:41.965224 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-40930a4c-f810-4a55-9592-c4256a4c2b5a req-d0d025e3-cfb6-4be1-bac6-e53ee3686cee tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2252300
May 31 16:22:41.966000 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Checking agent: {'id': '4bed2638-4d91-4afb-bf81-aacca8584621', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79381', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'started_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 22, 20), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:22:41.966342 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Checking segment: {'id': '44700c9f-b523-4212-86eb-cc7308ee0431', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 808, 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:22:41.966717 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Bound using segment: {'id': '44700c9f-b523-4212-86eb-cc7308ee0431', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 808, 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf'} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:22:41.967182 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Bound port: 747cd83a-69bc-48d9-8ba9-e9638b7be825, host: hv-cinder-79381, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '44700c9f-b523-4212-86eb-cc7308ee0431', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 808, 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf'}}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:22:41.967524 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:42.167806 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] For port 747cd83a-69bc-48d9-8ba9-e9638b7be825, host hv-cinder-79381, cleared binding levels {{(pid=91764) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:22:42.176121 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbf8a899-671f-44bc-b3c7-5e7428830771 req-e0db85c3-f82c-4647-afbe-2d5378163d87 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:42.177617 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cbf8a899-671f-44bc-b3c7-5e7428830771 req-e0db85c3-f82c-4647-afbe-2d5378163d87 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=68c4d303-4299-4977-888e-57c80b8530cc HTTP/1.1" status: 200  len: 854 time: 0.2643321
May 31 16:22:42.192626 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] For port 747cd83a-69bc-48d9-8ba9-e9638b7be825, host hv-cinder-79381, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=747cd83a-69bc-48d9-8ba9-e9638b7be825,segment=NetworkSegment(44700c9f-b523-4212-86eb-cc7308ee0431),segment_id=44700c9f-b523-4212-86eb-cc7308ee0431)] {{(pid=91764) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:22:42.235301 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 8cf870c7-bdf1-490f-adfa-61e27997bc91 up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:22:42.239748 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:42.246204 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-12f9c9b8-ea28-4a36-ae49-1edae546ddf2 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:42.277661 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cbf8a899-671f-44bc-b3c7-5e7428830771 req-fc7a1155-b8fd-4a9b-98dd-a5b8c7663e85 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=1097eeec-06a4-406d-ab4a-02e0123072d2&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0890524
May 31 16:22:42.309768 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port 8cf870c7-bdf1-490f-adfa-61e27997bc91 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:22:42.310494 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:42.340148 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c042165-2d67-46f9-9084-b9384e0572a2 req-0ca42d7a-278a-47d9-b410-11f6757e7929 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:42.341669 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4c042165-2d67-46f9-9084-b9384e0572a2 req-0ca42d7a-278a-47d9-b410-11f6757e7929 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 945 time: 0.5657449
May 31 16:22:42.378931 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:42.379539 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:42.380900 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] 10.222.0.63 "PUT /v2.0/ports/747cd83a-69bc-48d9-8ba9-e9638b7be825 HTTP/1.1" status: 200  len: 1093 time: 3.0315664
May 31 16:22:42.383410 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1d2436ad-b7ce-4d4c-851a-544a84fe2ef5', 'tag': '747cd83a-69bc-48d9-8ba9-e9638b7be825'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:22:42.385773 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-98e2e64c-5e8a-40cf-9648-aeb1a357b166" -d '{"events": [{"name": "network-changed", "server_uuid": "1d2436ad-b7ce-4d4c-851a-544a84fe2ef5", "tag": "747cd83a-69bc-48d9-8ba9-e9638b7be825"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:22:42.462707 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:42.495068 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '236769ac-e375-4497-9fe7-7425ccc79d09', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8cf870c7-bdf1-490f-adfa-61e27997bc91'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:22:42.498228 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-677e5f92-b4e3-40e6-9ec9-cdfa64ba7835" -d '{"events": [{"server_uuid": "236769ac-e375-4497-9fe7-7425ccc79d09", "name": "network-vif-plugged", "status": "completed", "tag": "8cf870c7-bdf1-490f-adfa-61e27997bc91"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:22:42.509321 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 8cf870c7-bdf1-490f-adfa-61e27997bc91, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=8cf870c7-bdf1-490f-adfa-61e27997bc91,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:22:42.515013 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:42.520218 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-fe8dd8e0-0e68-4dae-bd17-2041287bf305 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:42.558791 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Pushing event updated for resources: {'Port': ['ID=747cd83a-69bc-48d9-8ba9-e9638b7be825,revision_number=3']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:42.573203 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.327s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:42.581986 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-810f4b5f-98b3-4cbf-a468-f34678f9fe56 req-f0c8b76d-fec1-4787-8f45-981b747a4663 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:42.583545 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-810f4b5f-98b3-4cbf-a468-f34678f9fe56 req-f0c8b76d-fec1-4787-8f45-981b747a4663 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 943 time: 0.4927828
May 31 16:22:42.614018 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4c042165-2d67-46f9-9084-b9384e0572a2 req-f0fb0b65-a230-4bb6-a807-c87453921ca8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2628491
May 31 16:22:42.662122 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=8cf870c7-bdf1-490f-adfa-61e27997bc91,revision_number=7']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:42.666085 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:42.741702 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cbf8a899-671f-44bc-b3c7-5e7428830771 req-154ffa1c-2887-4dd4-a6f5-d81e8e502ce7 service neutron] 10.222.0.63 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4331560
May 31 16:22:43.050354 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-810f4b5f-98b3-4cbf-a468-f34678f9fe56 req-e65a05c8-6054-487d-a089-fb10d55aa81b tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4497311
May 31 16:22:43.057779 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-d896bd52-4993-43e5-84f5-c4f9902c02f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:43.059195 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-d896bd52-4993-43e5-84f5-c4f9902c02f0 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=8e66b29e29094a429643e0308704753b&device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 1096 time: 0.5886760
May 31 16:22:43.126903 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:22:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-11019d66-7a68-4f2d-b481-284f59be127a x-openstack-request-id: req-11019d66-7a68-4f2d-b481-284f59be127a {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:22:43.127365 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1d2436ad-b7ce-4d4c-851a-544a84fe2ef5", "tag": "747cd83a-69bc-48d9-8ba9-e9638b7be825", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:22:43.127719 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-11019d66-7a68-4f2d-b481-284f59be127a {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:22:43.128143 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1d2436ad-b7ce-4d4c-851a-544a84fe2ef5', 'tag': '747cd83a-69bc-48d9-8ba9-e9638b7be825', 'status': 'completed', 'code': 200}
May 31 16:22:43.143192 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:22:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dc583f3f-37a6-49ab-9811-7577deffed15 x-openstack-request-id: req-dc583f3f-37a6-49ab-9811-7577deffed15 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:22:43.143795 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "236769ac-e375-4497-9fe7-7425ccc79d09", "name": "network-vif-plugged", "status": "completed", "tag": "8cf870c7-bdf1-490f-adfa-61e27997bc91", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:22:43.144246 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-dc583f3f-37a6-49ab-9811-7577deffed15 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:22:43.144853 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '236769ac-e375-4497-9fe7-7425ccc79d09', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8cf870c7-bdf1-490f-adfa-61e27997bc91', 'code': 200}
May 31 16:22:43.157572 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-809294b8-c52a-40ec-9157-fa19acb23145 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=747cd83a-69bc-48d9-8ba9-e9638b7be825 HTTP/1.1" status: 200  len: 217 time: 0.0855670
May 31 16:22:43.186773 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cbf8a899-671f-44bc-b3c7-5e7428830771 req-4c9cfde8-7b69-4973-be66-8a6c2387cfac service neutron] 10.222.0.63 "GET /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4313982
May 31 16:22:43.230090 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ff0f3c-5c97-4c57-b76e-b34f70923343 req-6ecd9a0d-e5d8-4882-8aae-8dac01b48e58 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:43.231552 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b0ff0f3c-5c97-4c57-b76e-b34f70923343 req-6ecd9a0d-e5d8-4882-8aae-8dac01b48e58 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 945 time: 0.2958641
May 31 16:22:43.340235 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-8e5f61cf-a412-4a44-8d74-dc9de1b9aac0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:43.341711 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-8e5f61cf-a412-4a44-8d74-dc9de1b9aac0 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=1a675b0f-478f-47e0-acdd-51bacffe39b6 HTTP/1.1" status: 200  len: 853 time: 0.1491756
May 31 16:22:43.392116 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b0ff0f3c-5c97-4c57-b76e-b34f70923343 req-a9db09b6-48df-4506-b080-5c29bc5f7831 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1153708
May 31 16:22:43.433377 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93a0c97c-b96e-4597-98be-6957bcb2b41d req-04566f09-ad95-4624-afcf-a9fd21aa5363 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:43.434912 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-93a0c97c-b96e-4597-98be-6957bcb2b41d req-04566f09-ad95-4624-afcf-a9fd21aa5363 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.2024319
May 31 16:22:43.471512 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-7a8ff270-dd2d-488f-bd8e-7043b163a801 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:43.473145 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-7a8ff270-dd2d-488f-bd8e-7043b163a801 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=e3df5118-0a40-4a66-b31c-a978a0c899cf&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1176157
May 31 16:22:43.528408 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-93a0c97c-b96e-4597-98be-6957bcb2b41d req-bc622d7b-1833-4566-a091-3520757980b3 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0846691
May 31 16:22:43.753779 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-11fd96d4-0645-4fdb-bb32-3723e2743814 service neutron] 10.222.0.63 "GET /v2.0/networks/e3df5118-0a40-4a66-b31c-a978a0c899cf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2612586
May 31 16:22:43.771207 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-998dd68d-7749-477c-abb3-810179cfde45 req-6bbacf59-5fa8-4bfe-81f6-db60d15fae06 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:43.772712 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-998dd68d-7749-477c-abb3-810179cfde45 req-6bbacf59-5fa8-4bfe-81f6-db60d15fae06 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.2533643
May 31 16:22:43.869672 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52e73375-6a65-4cb1-a32a-9fed180367ed req-fa3ad3c9-a099-4e2b-b3cf-6c2562dc9868 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:43.871194 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-52e73375-6a65-4cb1-a32a-9fed180367ed req-fa3ad3c9-a099-4e2b-b3cf-6c2562dc9868 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 945 time: 0.2380466
May 31 16:22:43.964543 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-998dd68d-7749-477c-abb3-810179cfde45 req-81385b84-3ff8-4e2d-94e1-a63a337a2ff1 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1724169
May 31 16:22:43.989268 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-52e73375-6a65-4cb1-a32a-9fed180367ed req-27325d7d-319c-4713-b399-cfd7800cedb1 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1090100
May 31 16:22:43.997612 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a94e22ec-7070-4bae-a04d-0faa2b002a2c req-8de44027-778c-48b9-af30-8969bf2d9f74 service neutron] 10.222.0.63 "GET /v2.0/networks/e3df5118-0a40-4a66-b31c-a978a0c899cf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2345135
May 31 16:22:44.033798 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 33002) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:44.243637 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device ed28e094-e3fd-4150-b73d-a9ce8dff7be4 details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:22:44.378557 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86c4041f-320c-4ab7-bf4b-11097a4ba75f req-53b0504f-5967-4b39-b4f6-8a63186df5d3 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:44.380102 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-86c4041f-320c-4ab7-bf4b-11097a4ba75f req-53b0504f-5967-4b39-b4f6-8a63186df5d3 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.2114248
May 31 16:22:44.384783 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98e2e64c-5e8a-40cf-9648-aeb1a357b166 req-34f2246c-dad8-43e2-aaa6-722bf139382e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:44.386282 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-98e2e64c-5e8a-40cf-9648-aeb1a357b166 req-34f2246c-dad8-43e2-aaa6-722bf139382e service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=8e66b29e29094a429643e0308704753b&device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 1096 time: 0.3125196
May 31 16:22:44.426111 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f23dbf48-0e55-4cde-8d3f-392ac1d1a8cd req-96e67287-ee6f-4bbd-9dd0-c2b41b8737d8 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:44.427652 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f23dbf48-0e55-4cde-8d3f-392ac1d1a8cd req-96e67287-ee6f-4bbd-9dd0-c2b41b8737d8 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 943 time: 0.1859269
May 31 16:22:44.524567 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port ed28e094-e3fd-4150-b73d-a9ce8dff7be4, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=ed28e094-e3fd-4150-b73d-a9ce8dff7be4,segment=NetworkSegment(016e9daa-b906-4ec8-978d-cb58fbcd78da),segment_id=016e9daa-b906-4ec8-978d-cb58fbcd78da)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:22:44.545879 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': 'ed28e094-e3fd-4150-b73d-a9ce8dff7be4', 'network_id': '1097eeec-06a4-406d-ab4a-02e0123072d2', 'port_id': 'ed28e094-e3fd-4150-b73d-a9ce8dff7be4', 'mac_address': 'fa:16:3e:c2:39:46', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 838, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '68c4d303-4299-4977-888e-57c80b8530cc', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:22:44.646030 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:44.689694 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ed28e094-e3fd-4150-b73d-a9ce8dff7be4 {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:22:44.714325 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-86c4041f-320c-4ab7-bf4b-11097a4ba75f req-e811419c-a7b3-4a5f-b15f-6c3c1c4c770d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.3260863
May 31 16:22:44.731601 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port ed28e094-e3fd-4150-b73d-a9ce8dff7be4, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=ed28e094-e3fd-4150-b73d-a9ce8dff7be4,segment=NetworkSegment(016e9daa-b906-4ec8-978d-cb58fbcd78da),segment_id=016e9daa-b906-4ec8-978d-cb58fbcd78da)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:22:44.751193 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:44.755401 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:44.814225 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f23dbf48-0e55-4cde-8d3f-392ac1d1a8cd req-75a42cc5-be9f-4cb6-b0df-806e4a751286 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3553805
May 31 16:22:44.911667 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98e2e64c-5e8a-40cf-9648-aeb1a357b166 req-a6b61c5e-054d-4590-babc-cb2c1590c9c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:44.922680 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=ed28e094-e3fd-4150-b73d-a9ce8dff7be4,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:44.923671 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-98e2e64c-5e8a-40cf-9648-aeb1a357b166 req-a6b61c5e-054d-4590-babc-cb2c1590c9c7 service neutron] 10.222.0.63 "GET /v2.0/networks?id=e3df5118-0a40-4a66-b31c-a978a0c899cf HTTP/1.1" status: 200  len: 915 time: 0.4929688
May 31 16:22:44.932396 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ebda804-858d-48f4-b4fa-b2143a097aad tempest-TestVolumeBootPattern-2042821890 tempest-TestVolumeBootPattern-2042821890-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:44.934947 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-9ebda804-858d-48f4-b4fa-b2143a097aad tempest-TestVolumeBootPattern-2042821890 tempest-TestVolumeBootPattern-2042821890-project-admin] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 1093 time: 0.8991592
May 31 16:22:44.940658 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 33046) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:44.942230 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:44.948277 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Request body: {'floatingip': {'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'port_id': '95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'fixed_ip_address': '172.20.0.5'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:22:44.968470 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:22:44.989220 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Usage tracker for resource:floatingip and tenant:092115f69b8e401b8c334f7b3e797aad is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:22:45.005663 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:22:45.051340 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:22:45.081845 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for floatingip, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:45.238397 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['ed28e094-e3fd-4150-b73d-a9ce8dff7be4'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:22:45.371575 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:45.419747 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-98e2e64c-5e8a-40cf-9648-aeb1a357b166 req-280cec9e-dcec-4f61-9be1-919ca0b1ee07 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=747cd83a-69bc-48d9-8ba9-e9638b7be825 HTTP/1.1" status: 200  len: 217 time: 0.4759109
May 31 16:22:45.565861 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98e2e64c-5e8a-40cf-9648-aeb1a357b166 req-2e460ea7-1930-4f4f-929d-5b04150f26f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:45.567306 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-98e2e64c-5e8a-40cf-9648-aeb1a357b166 req-2e460ea7-1930-4f4f-929d-5b04150f26f3 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=1a675b0f-478f-47e0-acdd-51bacffe39b6 HTTP/1.1" status: 200  len: 853 time: 0.1217136
May 31 16:22:45.584423 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97e379c3-2511-4ef6-b550-b817f0c91a3a req-d07c00b6-4b85-45a9-a1bc-297aaff5065e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:45.585901 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-97e379c3-2511-4ef6-b550-b817f0c91a3a req-d07c00b6-4b85-45a9-a1bc-297aaff5065e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 944 time: 0.2550201
May 31 16:22:45.598497 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76c79829-2954-4b58-b303-fe5fb8ba5f47 req-11436836-1a2c-4704-b9ec-b6b9f3d125e6 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:45.600102 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-76c79829-2954-4b58-b303-fe5fb8ba5f47 req-11436836-1a2c-4704-b9ec-b6b9f3d125e6 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.6638892
May 31 16:22:45.675988 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Allocated IP 172.27.0.222 (00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c/96709d85-d0fe-4cf8-b232-eaf6b143ebe6/7ed12cbb-9226-4ddd-9d1e-f822288e8260) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:22:45.868037 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-76c79829-2954-4b58-b303-fe5fb8ba5f47 req-2ccc7b8c-0e0b-4c86-bd16-50c8ea02ff06 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1719208
May 31 16:22:45.880050 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-97e379c3-2511-4ef6-b550-b817f0c91a3a req-dd14902e-a3c6-46b0-b494-158766e70241 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1936123
May 31 16:22:45.907887 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98e2e64c-5e8a-40cf-9648-aeb1a357b166 req-29ec27e6-1aa9-4c83-9b8c-2f6fee9bd4b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:45.914296 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-98e2e64c-5e8a-40cf-9648-aeb1a357b166 req-29ec27e6-1aa9-4c83-9b8c-2f6fee9bd4b5 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=e3df5118-0a40-4a66-b31c-a978a0c899cf&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3131950
May 31 16:22:46.070778 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:46.183157 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:46.206390 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:46.250924 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 747cd83a-69bc-48d9-8ba9-e9638b7be825 details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:22:46.279035 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:22:46.285807 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:22:46.295158 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:22:46.388954 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Pushing event updated for resources: {'Port': ['ID=7ed12cbb-9226-4ddd-9d1e-f822288e8260,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:46.395738 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:46.410541 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-98e2e64c-5e8a-40cf-9648-aeb1a357b166 req-cded8955-a8f5-464e-9b7e-149b5813a754 service neutron] 10.222.0.63 "GET /v2.0/networks/e3df5118-0a40-4a66-b31c-a978a0c899cf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4863060
May 31 16:22:46.568059 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 747cd83a-69bc-48d9-8ba9-e9638b7be825, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=747cd83a-69bc-48d9-8ba9-e9638b7be825,segment=NetworkSegment(44700c9f-b523-4212-86eb-cc7308ee0431),segment_id=44700c9f-b523-4212-86eb-cc7308ee0431)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:22:46.605659 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ec1e61a-ec48-41ef-b8cd-7a5f8c819a5d req-1c68048d-4b24-4bc6-8f4e-6dd676f27e68 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:46.606292 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': '747cd83a-69bc-48d9-8ba9-e9638b7be825', 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf', 'port_id': '747cd83a-69bc-48d9-8ba9-e9638b7be825', 'mac_address': 'fa:16:3e:54:a8:7d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 808, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1a675b0f-478f-47e0-acdd-51bacffe39b6', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:22:46.607202 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3ec1e61a-ec48-41ef-b8cd-7a5f8c819a5d req-1c68048d-4b24-4bc6-8f4e-6dd676f27e68 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.4665761
May 31 16:22:46.643608 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f70bc27a-0728-4389-ba00-8b72305b9cd7 req-412b9ce6-328e-4038-8c05-fb93499a894e tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:46.644651 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f70bc27a-0728-4389-ba00-8b72305b9cd7 req-412b9ce6-328e-4038-8c05-fb93499a894e tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 943 time: 0.4879522
May 31 16:22:46.714794 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:46.755396 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 747cd83a-69bc-48d9-8ba9-e9638b7be825 {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:22:46.809168 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 747cd83a-69bc-48d9-8ba9-e9638b7be825, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=747cd83a-69bc-48d9-8ba9-e9638b7be825,segment=NetworkSegment(44700c9f-b523-4212-86eb-cc7308ee0431),segment_id=44700c9f-b523-4212-86eb-cc7308ee0431)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:22:46.817148 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:46.821146 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:46.891225 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3ec1e61a-ec48-41ef-b8cd-7a5f8c819a5d req-f1a9754a-fd79-404f-bfea-1d483e441dc5 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2362027
May 31 16:22:47.009816 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=747cd83a-69bc-48d9-8ba9-e9638b7be825,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:47.021574 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:47.028811 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:47.079586 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f70bc27a-0728-4389-ba00-8b72305b9cd7 req-a7698aa5-8907-4380-9001-f256ee9a7c24 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4066978
May 31 16:22:47.102706 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-98e2e64c-5e8a-40cf-9648-aeb1a357b166 req-3ef50594-3aef-45ec-bac6-8ede5d211727 service neutron] 10.222.0.63 "GET /v2.0/networks/e3df5118-0a40-4a66-b31c-a978a0c899cf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6797137
May 31 16:22:47.206642 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:47.246018 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['747cd83a-69bc-48d9-8ba9-e9638b7be825'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:22:47.676887 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10426632-e07e-4a66-82ff-6131dc92cdd9 req-e11976a6-f7de-404f-8a45-8c5af9ee43db tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:47.680302 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-10426632-e07e-4a66-82ff-6131dc92cdd9 req-e11976a6-f7de-404f-8a45-8c5af9ee43db tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.4779480
May 31 16:22:47.729512 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a10b45b-cf47-48e1-ab75-8f99f04f8c0c req-c24ac668-05fb-4518-9553-fbdd19cc31e0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:47.738226 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5a10b45b-cf47-48e1-ab75-8f99f04f8c0c req-c24ac668-05fb-4518-9553-fbdd19cc31e0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 944 time: 0.3338840
May 31 16:22:47.807380 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5a10b45b-cf47-48e1-ab75-8f99f04f8c0c req-32c50a50-d929-4168-901b-5229562111d4 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0679338
May 31 16:22:47.824068 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for port, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:47.833296 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14337082'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:47.836664 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-10426632-e07e-4a66-82ff-6131dc92cdd9 req-f686e2ad-1d53-43be-acc9-2e74383f3f0b tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1504278
May 31 16:22:47.856040 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.002s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:47.941148 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Pushing event updated for resources: {'Port': ['ID=7ed12cbb-9226-4ddd-9d1e-f822288e8260,revision_number=2']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:47.945736 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:48.033133 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16621821'] for floatingip, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:48.184634 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49e209fd-f2cd-4661-9d09-712107d2b4db req-ffaa3b1c-411f-4f9d-b304-9d6b55c6584d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:48.199410 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-49e209fd-f2cd-4661-9d09-712107d2b4db req-ffaa3b1c-411f-4f9d-b304-9d6b55c6584d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.1596661
May 31 16:22:48.255719 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device ed28e094-e3fd-4150-b73d-a9ce8dff7be4 up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:22:48.306838 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.l3_db [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Floating IP 3c15c76f-9cda-471e-b526-617f49a22ed5 associated. External IP: 172.27.0.222, port: 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b.
May 31 16:22:48.344765 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-49e209fd-f2cd-4661-9d09-712107d2b4db req-fcb663bf-2dff-400d-91d4-3ca5c0e7bb67 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1391907
May 31 16:22:48.424704 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning for port ed28e094-e3fd-4150-b73d-a9ce8dff7be4 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:22:48.431997 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port ed28e094-e3fd-4150-b73d-a9ce8dff7be4 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:22:48.432467 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:48.436475 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e1cda94-0e53-418f-89fe-b92693d7e30b req-df0f2d74-0450-4a34-9f6f-935c065eafb8 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:48.438843 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0e1cda94-0e53-418f-89fe-b92693d7e30b req-df0f2d74-0450-4a34-9f6f-935c065eafb8 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 944 time: 0.1599946
May 31 16:22:48.514491 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0e1cda94-0e53-418f-89fe-b92693d7e30b req-a3b1be71-bc30-44fd-99fd-16fc90df2d2f tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0668752
May 31 16:22:48.770332 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:48.821881 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '69990510-6c38-4988-a0ec-18ae79233830', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ed28e094-e3fd-4150-b73d-a9ce8dff7be4'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:22:48.825220 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cff74816-f71a-4d4f-b35c-e93c05415416" -d '{"events": [{"server_uuid": "69990510-6c38-4988-a0ec-18ae79233830", "name": "network-vif-plugged", "status": "completed", "tag": "ed28e094-e3fd-4150-b73d-a9ce8dff7be4"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:22:48.837551 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port ed28e094-e3fd-4150-b73d-a9ce8dff7be4, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=ed28e094-e3fd-4150-b73d-a9ce8dff7be4,segment=NetworkSegment(016e9daa-b906-4ec8-978d-cb58fbcd78da),segment_id=016e9daa-b906-4ec8-978d-cb58fbcd78da)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:22:48.846017 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:48.849886 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-f6352fe7-87df-4cc2-8070-62749c7ab3d2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:48.980045 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=ed28e094-e3fd-4150-b73d-a9ce8dff7be4,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:48.994388 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:48.999548 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:22:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fc1fc467-3893-4411-9686-7fd7061ea43a x-openstack-request-id: req-fc1fc467-3893-4411-9686-7fd7061ea43a {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:22:48.999847 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "69990510-6c38-4988-a0ec-18ae79233830", "name": "network-vif-plugged", "status": "completed", "tag": "ed28e094-e3fd-4150-b73d-a9ce8dff7be4", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:22:49.000104 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-fc1fc467-3893-4411-9686-7fd7061ea43a {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:22:49.000503 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '69990510-6c38-4988-a0ec-18ae79233830', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ed28e094-e3fd-4150-b73d-a9ce8dff7be4', 'code': 200}
May 31 16:22:49.044013 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Router 80126872-1960-4f13-9ca2-0eaf66181e32 has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91763) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:22:49.141994 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37bcb40c-adee-4f2a-a17b-cc5bea434a69 req-13fe75c3-65bc-4459-b794-b9f0d1f9ce21 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:49.144041 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-37bcb40c-adee-4f2a-a17b-cc5bea434a69 req-13fe75c3-65bc-4459-b794-b9f0d1f9ce21 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 945 time: 0.1329844
May 31 16:22:49.377991 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-37bcb40c-adee-4f2a-a17b-cc5bea434a69 req-284c65a3-1e62-4fa6-9bb3-3d6b909bd093 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2272756
May 31 16:22:49.407702 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:22:49.419975 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a125092-fc5f-4bb6-bd5c-db4d924b6502 req-5accff0f-9783-49b5-b069-7317cac0a305 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:49.420501 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24eacad5-1fae-413a-a120-7ec2957bb78f None None] Sync routers for ids ['80126872-1960-4f13-9ca2-0eaf66181e32'] in dv-cinder-793814-1-iscsi {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:22:49.428963 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8a125092-fc5f-4bb6-bd5c-db4d924b6502 req-5accff0f-9783-49b5-b069-7317cac0a305 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 1098 time: 0.1560473
May 31 16:22:49.433248 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24eacad5-1fae-413a-a120-7ec2957bb78f None None] Routers {'80126872-1960-4f13-9ca2-0eaf66181e32'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:22:49.434215 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-24eacad5-1fae-413a-a120-7ec2957bb78f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1427067a60>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:22:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['80126872-1960-4f13-9ca2-0eaf66181e32'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:22:49.483519 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for floatingip, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:49.544369 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8a125092-fc5f-4bb6-bd5c-db4d924b6502 req-87acf296-767f-4331-94e7-6c0265252982 service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1067102
May 31 16:22:49.574230 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d44d0b34-9210-45b2-8257-73e8bbad9332 req-31fda8c0-ef37-4e19-bc2e-a89beed5a802 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:49.586922 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d44d0b34-9210-45b2-8257-73e8bbad9332 req-31fda8c0-ef37-4e19-bc2e-a89beed5a802 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.3732989
May 31 16:22:49.594344 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 4.6503830
May 31 16:22:49.595006 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '643ad40e-ebf7-432d-ae76-1ce2164e9eec', 'tag': '95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:22:49.605233 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b8f4c7a8-f595-41b3-847f-71dec2a2c00a" -d '{"events": [{"name": "network-changed", "server_uuid": "643ad40e-ebf7-432d-ae76-1ce2164e9eec", "tag": "95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:22:49.612221 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:49.795658 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d44d0b34-9210-45b2-8257-73e8bbad9332 req-864b1fb1-126a-4c74-a4e7-f6f08815ed6d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2075281
May 31 16:22:49.811936 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-24eacad5-1fae-413a-a120-7ec2957bb78f None None] Set router 80126872-1960-4f13-9ca2-0eaf66181e32 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:22:49.836371 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c610192b-348f-4f1e-8a42-4878a61a4b2c req-ae458e8e-3a7a-4b5c-bb01-c25c44dffd01 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:49.842471 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c610192b-348f-4f1e-8a42-4878a61a4b2c req-ae458e8e-3a7a-4b5c-bb01-c25c44dffd01 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.2998662
May 31 16:22:49.968773 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c610192b-348f-4f1e-8a42-4878a61a4b2c req-c6272c8b-c61f-433d-bac8-3de1cb5c4602 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1104648
May 31 16:22:50.053949 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:22:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-64412aee-6510-4c65-8ac5-c23f149a34f7 x-openstack-request-id: req-64412aee-6510-4c65-8ac5-c23f149a34f7 {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:22:50.054280 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "643ad40e-ebf7-432d-ae76-1ce2164e9eec", "tag": "95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:22:50.054559 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-64412aee-6510-4c65-8ac5-c23f149a34f7 {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:22:50.054995 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '643ad40e-ebf7-432d-ae76-1ce2164e9eec', 'tag': '95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b', 'status': 'completed', 'code': 200}
May 31 16:22:50.290140 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 747cd83a-69bc-48d9-8ba9-e9638b7be825 up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:22:50.331828 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f4c7a8-f595-41b3-847f-71dec2a2c00a req-d202d70a-8e95-413c-9b80-c8a8867de26b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:50.333502 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b8f4c7a8-f595-41b3-847f-71dec2a2c00a req-d202d70a-8e95-413c-9b80-c8a8867de26b service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=092115f69b8e401b8c334f7b3e797aad&device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 1098 time: 0.2326312
May 31 16:22:50.394767 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93c7406d-753d-430d-a3c4-02ed79467a47 req-0b4ff11c-3b14-49ba-96fa-37eb7e735ddf tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:50.428460 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-93c7406d-753d-430d-a3c4-02ed79467a47 req-0b4ff11c-3b14-49ba-96fa-37eb7e735ddf tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 944 time: 0.4292350
May 31 16:22:50.469290 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning for port 747cd83a-69bc-48d9-8ba9-e9638b7be825 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:22:50.476202 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port 747cd83a-69bc-48d9-8ba9-e9638b7be825 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:22:50.478599 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:50.683534 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-24eacad5-1fae-413a-a120-7ec2957bb78f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1427067a60>, [{'id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229'}], 'enable_snat': True}, 'gw_port_id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:05Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 4, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'gw_port': {'id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:b8:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:06Z', 'updated_at': '2021-05-31T16:21:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': '3c15c76f-9cda-471e-b526-617f49a22ed5', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'floating_ip_address': '172.27.0.222', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'port_id': '95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 427, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'mac_address': 'fa:16:3e:1a:ff:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '643ad40e-ebf7-432d-ae76-1ce2164e9eec', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:22:46Z', 'updated_at': '2021-05-31T16:22:46Z', 'revision_number': 0, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '27a83f61-e253-4ba1-954c-e810e9a33917', 'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'mac_address': 'fa:16:3e:fc:8a:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_interface', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:09Z', 'updated_at': '2021-05-31T16:21:20Z', 'revision_number': 5, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'subnets': [{'id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:22:50.704045 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24eacad5-1fae-413a-a120-7ec2957bb78f None None] Checking router: 80126872-1960-4f13-9ca2-0eaf66181e32 for host: dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:22:50.825042 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24eacad5-1fae-413a-a120-7ec2957bb78f None None] Routers {'80126872-1960-4f13-9ca2-0eaf66181e32'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:22:50.832358 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-24eacad5-1fae-413a-a120-7ec2957bb78f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1427067a60>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:22:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['80126872-1960-4f13-9ca2-0eaf66181e32'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:22:50.886991 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:51.082131 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 747cd83a-69bc-48d9-8ba9-e9638b7be825, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=747cd83a-69bc-48d9-8ba9-e9638b7be825,segment=NetworkSegment(44700c9f-b523-4212-86eb-cc7308ee0431),segment_id=44700c9f-b523-4212-86eb-cc7308ee0431)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:22:51.084310 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-93c7406d-753d-430d-a3c4-02ed79467a47 req-4bfe5700-063d-42b4-8e9d-31552897c8c6 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.6545277
May 31 16:22:51.084536 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1d2436ad-b7ce-4d4c-851a-544a84fe2ef5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '747cd83a-69bc-48d9-8ba9-e9638b7be825'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:22:51.098886 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d337669f-fa82-4a84-9047-0add9c3df8eb" -d '{"events": [{"server_uuid": "1d2436ad-b7ce-4d4c-851a-544a84fe2ef5", "name": "network-vif-plugged", "status": "completed", "tag": "747cd83a-69bc-48d9-8ba9-e9638b7be825"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:22:51.111310 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:51.115745 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2276730f-71b6-41f9-8b61-f799e5de6a6a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:51.288618 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f4c7a8-f595-41b3-847f-71dec2a2c00a req-3c5649e5-4ae6-42ac-91e9-92932ce3ce2d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:51.303574 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b8f4c7a8-f595-41b3-847f-71dec2a2c00a req-3c5649e5-4ae6-42ac-91e9-92932ce3ce2d service neutron] 10.222.0.63 "GET /v2.0/networks?id=5b237728-dc31-4203-bbac-66ce3db1593a HTTP/1.1" status: 200  len: 913 time: 0.9526780
May 31 16:22:51.319278 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=747cd83a-69bc-48d9-8ba9-e9638b7be825,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:51.325796 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:51.326334 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76ceb177-8c01-44c1-b106-f1c0364def81 req-571fdd5c-8b9b-441b-9f80-09a909c63f3c tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:51.337943 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-76ceb177-8c01-44c1-b106-f1c0364def81 req-571fdd5c-8b9b-441b-9f80-09a909c63f3c tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 945 time: 0.6760368
May 31 16:22:51.367013 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-24eacad5-1fae-413a-a120-7ec2957bb78f None None] Set router 80126872-1960-4f13-9ca2-0eaf66181e32 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:22:51.534923 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b8f4c7a8-f595-41b3-847f-71dec2a2c00a req-aeb9c5de-0382-4048-a949-e124fb75404d service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b HTTP/1.1" status: 200  len: 999 time: 0.1948290
May 31 16:22:51.545021 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-76ceb177-8c01-44c1-b106-f1c0364def81 req-b5afdd36-0427-446a-ada9-87d9e6f2bd70 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2061093
May 31 16:22:51.727698 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f4c7a8-f595-41b3-847f-71dec2a2c00a req-db464a8b-6742-4fe5-b319-4c0b5b235be1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:51.729230 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b8f4c7a8-f595-41b3-847f-71dec2a2c00a req-db464a8b-6742-4fe5-b319-4c0b5b235be1 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=995d9a2e-7e88-458e-9385-d135c0e07276 HTTP/1.1" status: 200  len: 851 time: 0.1832559
May 31 16:22:51.826533 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8447fb5-25f4-4e41-b7d6-290f08ee1363 req-77d146e0-ab17-4ac0-8502-0b79524d5d43 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:51.834264 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b8447fb5-25f4-4e41-b7d6-290f08ee1363 req-77d146e0-ab17-4ac0-8502-0b79524d5d43 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.4392836
May 31 16:22:51.888846 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-24eacad5-1fae-413a-a120-7ec2957bb78f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1427067a60>, [{'id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229'}], 'enable_snat': True}, 'gw_port_id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:05Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 4, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'gw_port': {'id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:b8:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:06Z', 'updated_at': '2021-05-31T16:21:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': '3c15c76f-9cda-471e-b526-617f49a22ed5', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'floating_ip_address': '172.27.0.222', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'port_id': '95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 427, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'mac_address': 'fa:16:3e:1a:ff:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '643ad40e-ebf7-432d-ae76-1ce2164e9eec', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:22:46Z', 'updated_at': '2021-05-31T16:22:46Z', 'revision_number': 0, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '27a83f61-e253-4ba1-954c-e810e9a33917', 'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'mac_address': 'fa:16:3e:fc:8a:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_interface', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:09Z', 'updated_at': '2021-05-31T16:21:20Z', 'revision_number': 5, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'subnets': [{'id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:22:51.898919 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24eacad5-1fae-413a-a120-7ec2957bb78f None None] The sync data for ids ['80126872-1960-4f13-9ca2-0eaf66181e32'] in dv-cinder-793814-1-iscsi is: [{'id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229'}], 'enable_snat': True}, 'gw_port_id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:05Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 4, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'gw_port': {'id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:b8:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:06Z', 'updated_at': '2021-05-31T16:21:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': '3c15c76f-9cda-471e-b526-617f49a22ed5', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'floating_ip_address': '172.27.0.222', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'port_id': '95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 427, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'mac_address': 'fa:16:3e:1a:ff:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '643ad40e-ebf7-432d-ae76-1ce2164e9eec', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:22:46Z', 'updated_at': '2021-05-31T16:22:46Z', 'revision_number': 0, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '27a83f61-e253-4ba1-954c-e810e9a33917', 'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'mac_address': 'fa:16:3e:fc:8a:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_interface', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:09Z', 'updated_at': '2021-05-31T16:21:20Z', 'revision_number': 5, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'subnets': [{'id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:22:51.965167 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b8447fb5-25f4-4e41-b7d6-290f08ee1363 req-d40e9c61-181e-4c7e-87aa-d4777967e413 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1296196
May 31 16:22:52.025869 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf8b84f-9dd8-40bd-ad43-84ce8c48e7a8 req-6d066d02-4d0e-4930-b981-f24cf21a8e39 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:52.032991 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4cf8b84f-9dd8-40bd-ad43-84ce8c48e7a8 req-6d066d02-4d0e-4930-b981-f24cf21a8e39 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.3006372
May 31 16:22:52.076405 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:22:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c05fd4dd-c23b-4de0-ba1b-8cc6a7957673 x-openstack-request-id: req-c05fd4dd-c23b-4de0-ba1b-8cc6a7957673 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:22:52.077051 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1d2436ad-b7ce-4d4c-851a-544a84fe2ef5", "name": "network-vif-plugged", "status": "completed", "tag": "747cd83a-69bc-48d9-8ba9-e9638b7be825", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:22:52.077051 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-c05fd4dd-c23b-4de0-ba1b-8cc6a7957673 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:22:52.077404 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1d2436ad-b7ce-4d4c-851a-544a84fe2ef5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '747cd83a-69bc-48d9-8ba9-e9638b7be825', 'code': 200}
May 31 16:22:52.085853 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f4c7a8-f595-41b3-847f-71dec2a2c00a req-128ca35c-b401-4075-bd4c-6a0f0ac1688f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:52.087462 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b8f4c7a8-f595-41b3-847f-71dec2a2c00a req-128ca35c-b401-4075-bd4c-6a0f0ac1688f service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=5b237728-dc31-4203-bbac-66ce3db1593a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3108051
May 31 16:22:52.147260 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4cf8b84f-9dd8-40bd-ad43-84ce8c48e7a8 req-241a54bf-d2f1-456b-9c97-0ba451e15cd3 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0981221
May 31 16:22:52.354587 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e92714ce-83ea-4b05-83fc-e9abfe4e8bf5 None None] New status for floating IP 3c15c76f-9cda-471e-b526-617f49a22ed5: ACTIVE {{(pid=91765) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 31 16:22:52.739772 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b8f4c7a8-f595-41b3-847f-71dec2a2c00a req-7a66d5d8-8cbf-468f-aae6-4b89810fe0e7 service neutron] 10.222.0.63 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.6397545
May 31 16:22:52.967152 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1e4f237-7e7f-4486-be3c-94f1a930d79d req-3bc4cfe6-958f-456c-8f32-c5060a64a809 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:52.968546 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f1e4f237-7e7f-4486-be3c-94f1a930d79d req-3bc4cfe6-958f-456c-8f32-c5060a64a809 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 1098 time: 0.5552731
May 31 16:22:52.973218 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-401b814c-22a5-4f5e-9b78-ef9429b7f428 req-07890eb5-027a-4b5b-9eeb-c7795a20003b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:52.977446 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f714bdf2-8272-40a0-87f8-ccdeca1d0035 req-50787878-d11d-4ed8-9831-6b88105eec59 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:52.978894 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-401b814c-22a5-4f5e-9b78-ef9429b7f428 req-07890eb5-027a-4b5b-9eeb-c7795a20003b service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 1099 time: 0.1756899
May 31 16:22:52.979043 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f714bdf2-8272-40a0-87f8-ccdeca1d0035 req-50787878-d11d-4ed8-9831-6b88105eec59 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 945 time: 0.4123847
May 31 16:22:53.070030 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-401b814c-22a5-4f5e-9b78-ef9429b7f428 req-416ae528-e386-4ae4-9f89-0a841c1e0243 service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0819495
May 31 16:22:53.148999 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f1e4f237-7e7f-4486-be3c-94f1a930d79d req-daaf1e38-dcb2-4bfd-baf9-0e2e9e72971b service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1658764
May 31 16:22:53.237738 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f714bdf2-8272-40a0-87f8-ccdeca1d0035 req-241b4c1e-7ec4-4a24-a68f-d2f82b719b86 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2099569
May 31 16:22:53.245793 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b8f4c7a8-f595-41b3-847f-71dec2a2c00a req-6da06019-4793-4e41-bef5-2848fb243d61 service neutron] 10.222.0.63 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4957812
May 31 16:22:53.285680 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60dde4f1-0fa4-434e-a627-ac39fb36d0d9 req-5887b36e-b616-43cc-b0d2-a69d7155d1f1 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:53.294398 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-60dde4f1-0fa4-434e-a627-ac39fb36d0d9 req-5887b36e-b616-43cc-b0d2-a69d7155d1f1 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 945 time: 0.4960160
May 31 16:22:53.386657 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-60dde4f1-0fa4-434e-a627-ac39fb36d0d9 req-9e95bdad-d377-45b2-9ca9-2ee61d857681 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0907512
May 31 16:22:53.534535 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f368ffb-b3df-40b0-9e2c-4139c0ac83bc req-cd71dde6-d925-4d40-a0b6-4532bb30c49d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:53.536052 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5f368ffb-b3df-40b0-9e2c-4139c0ac83bc req-cd71dde6-d925-4d40-a0b6-4532bb30c49d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.1450915
May 31 16:22:53.659018 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5f368ffb-b3df-40b0-9e2c-4139c0ac83bc req-9d0d8a42-b230-4b68-bcc4-4f100f4c879e tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0806975
May 31 16:22:53.688816 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9009fa1a-9532-4cda-8dd8-a2e4ac1e0904 req-7857223a-ccfb-4285-a756-48b55ce87b22 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:53.697392 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9009fa1a-9532-4cda-8dd8-a2e4ac1e0904 req-7857223a-ccfb-4285-a756-48b55ce87b22 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.1602414
May 31 16:22:53.769872 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9009fa1a-9532-4cda-8dd8-a2e4ac1e0904 req-c88d9b78-61f8-4d6c-9b5c-da2f49136932 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0679746
May 31 16:22:54.029354 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 33212) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:54.286656 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bc243934-e24a-4488-8be9-cc0d56ffad51 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:54.308172 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-bc243934-e24a-4488-8be9-cc0d56ffad51 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:22:54.312252 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-bc243934-e24a-4488-8be9-cc0d56ffad51 admin admin] Usage tracker for resource:security_group_rule and tenant:73ea494c0e0f45f392ca3790f04efc0d is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:22:54.316543 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-bc243934-e24a-4488-8be9-cc0d56ffad51 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:22:54.322436 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-bc243934-e24a-4488-8be9-cc0d56ffad51 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:22:54.534015 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3585512-41a6-4e65-a9e6-0373a810ba4a req-413996cb-1702-460d-b2a3-df3a68dbc7a3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:54.536522 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d3585512-41a6-4e65-a9e6-0373a810ba4a req-413996cb-1702-460d-b2a3-df3a68dbc7a3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 945 time: 0.1479557
May 31 16:22:54.565713 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bc243934-e24a-4488-8be9-cc0d56ffad51 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:54.575685 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bc243934-e24a-4488-8be9-cc0d56ffad51 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:54.593787 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c3cff972-7734-4b34-b64a-4ae67551df13 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:54.642184 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-bc243934-e24a-4488-8be9-cc0d56ffad51 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=73ea494c0e0f45f392ca3790f04efc0d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6116946
May 31 16:22:54.645883 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 33222) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:54.654380 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d3585512-41a6-4e65-a9e6-0373a810ba4a req-c01b2081-af6d-4b7b-9483-68431d839976 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1088049
May 31 16:22:54.673569 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc243934-e24a-4488-8be9-cc0d56ffad51 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4d95c008-f587-4dfc-8df2-bf4226ec4030,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:54.678326 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-bc243934-e24a-4488-8be9-cc0d56ffad51 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:54.755202 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7f26f360-3ace-4742-8588-208b0db5daec admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:54.887424 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36767304-56ab-46ac-b4b1-81e5f4ea9dcc req-86712ed5-c270-4098-b05e-f705b22fe671 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:54.889358 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-36767304-56ab-46ac-b4b1-81e5f4ea9dcc req-86712ed5-c270-4098-b05e-f705b22fe671 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.1080775
May 31 16:22:54.917149 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7f26f360-3ace-4742-8588-208b0db5daec admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:55.020601 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7f26f360-3ace-4742-8588-208b0db5daec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:55.027454 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-36767304-56ab-46ac-b4b1-81e5f4ea9dcc req-56549cc8-5df4-433d-aef3-6320044b8b19 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1294470
May 31 16:22:55.029740 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-f220a1f4-061d-46ab-b4ae-e0afa18f8962 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:55.048971 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f26f360-3ace-4742-8588-208b0db5daec admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4d95c008-f587-4dfc-8df2-bf4226ec4030,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:55.058841 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7f26f360-3ace-4742-8588-208b0db5daec admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:55.060830 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-7f26f360-3ace-4742-8588-208b0db5daec admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/4d95c008-f587-4dfc-8df2-bf4226ec4030 HTTP/1.1" status: 204  len: 168 time: 0.4102821
May 31 16:22:55.066859 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-7f26f360-3ace-4742-8588-208b0db5daec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:55.113674 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d46b5f9-1356-456e-8868-0b606981c7c1 req-6859fac7-7582-4ad9-97c3-73cd9f97b62d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:55.120923 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8d46b5f9-1356-456e-8868-0b606981c7c1 req-6859fac7-7582-4ad9-97c3-73cd9f97b62d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.1992357
May 31 16:22:55.174478 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8d46b5f9-1356-456e-8868-0b606981c7c1 req-6711de55-01fc-41d4-852c-ce2732e593b2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0519390
May 31 16:22:55.916849 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28588e31-4c6f-4fd7-b4f8-885fe8e2032b req-5d381585-6236-42db-8a8a-021ff90bfac2 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:55.918564 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-28588e31-4c6f-4fd7-b4f8-885fe8e2032b req-5d381585-6236-42db-8a8a-021ff90bfac2 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 945 time: 0.1315041
May 31 16:22:55.969255 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-28588e31-4c6f-4fd7-b4f8-885fe8e2032b req-a6115f35-8bd4-471f-9371-5e082a02d439 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0443702
May 31 16:22:56.049087 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 33262) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:56.191074 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-2010572059-network', 'tenant_id': '8f633dd4e3b241db904e4505f98ebe62'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:22:56.196010 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:22:56.200171 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Usage tracker for resource:network and tenant:8f633dd4e3b241db904e4505f98ebe62 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:22:56.206268 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:22:56.214452 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:22:56.230164 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Made reservation on behalf of 8f633dd4e3b241db904e4505f98ebe62 for: {'network': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:22:56.234443 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-639279'] for network, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:56.276033 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:56.318763 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:22:56.323126 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Usage tracker for resource:security_group_rule and tenant:8f633dd4e3b241db904e4505f98ebe62 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:22:56.327834 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:22:56.344773 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:22:56.345635 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ffd3ce8-b33c-4fba-a824-766d679adc4c req-997d69cb-00f4-4f24-bc98-a50f86a5abd4 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:56.354171 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8ffd3ce8-b33c-4fba-a824-766d679adc4c req-997d69cb-00f4-4f24-bc98-a50f86a5abd4 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.1039412
May 31 16:22:56.474574 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:56.481252 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:56.489188 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8ffd3ce8-b33c-4fba-a824-766d679adc4c req-033755e4-dd27-4edc-8021-3d19445351df tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1335132
May 31 16:22:56.492123 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-7f26f360-3ace-4742-8588-208b0db5daec admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:56.526866 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 820}  {{(pid=91763) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 31 16:22:56.527950 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba83d658-7db1-4067-93c4-574069504de7 req-897a8157-1a99-4a9d-9e1c-2900b7bf05ea tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:56.536254 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ba83d658-7db1-4067-93c4-574069504de7 req-897a8157-1a99-4a9d-9e1c-2900b7bf05ea tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.1522739
May 31 16:22:56.544074 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b7938be0-8a2c-4f7f-97e1-241934e0bfb0,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:56.558370 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:56.565441 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:56.565919 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.segments_db [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Added segment 54d58804-a1bf-4e3a-8d44-cdd8f5cc124a of type vlan for network 52011424-acd2-4b1b-9a3c-ebda39ad09da
May 31 16:22:56.591636 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ba83d658-7db1-4067-93c4-574069504de7 req-1d1a9d78-b092-48a3-8ce3-1f43cfa22e26 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0537300
May 31 16:22:56.613221 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732784079930'] for network, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:56.650234 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366'] for network, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:56.652590 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:56.653267 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:56.660606 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:56.782041 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Pushing event updated for resources: {'Network': ['ID=52011424-acd2-4b1b-9a3c-ebda39ad09da,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:56.786288 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:56.793629 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Network 52011424-acd2-4b1b-9a3c-ebda39ad09da details requested by agent ovs-agent-dv-cinder-793814-1-iscsi with host dv-cinder-793814-1-iscsi {{(pid=91765) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 31 16:22:56.795638 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 0.7454045
May 31 16:22:56.799099 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 33276) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:22:56.806870 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-3550d8fb-8a93-4afc-82fb-4ac2e4a4979c admin admin] Request body: {'subnet': {'network_id': '52011424-acd2-4b1b-9a3c-ebda39ad09da', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-2010572059-subnet', 'tenant_id': '8f633dd4e3b241db904e4505f98ebe62', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:22:56.816466 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-3550d8fb-8a93-4afc-82fb-4ac2e4a4979c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:22:56.822335 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-3550d8fb-8a93-4afc-82fb-4ac2e4a4979c admin admin] Usage tracker for resource:subnet and tenant:8f633dd4e3b241db904e4505f98ebe62 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:22:56.825795 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-3550d8fb-8a93-4afc-82fb-4ac2e4a4979c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:22:56.833849 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-3550d8fb-8a93-4afc-82fb-4ac2e4a4979c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:22:56.850401 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3550d8fb-8a93-4afc-82fb-4ac2e4a4979c admin admin] Made reservation on behalf of 8f633dd4e3b241db904e4505f98ebe62 for: {'subnet': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:22:56.853935 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3550d8fb-8a93-4afc-82fb-4ac2e4a4979c admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14793668'] for subnet, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:57.487970 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bbe9cae-4973-4bf4-bfe0-e0d1b6f783c1 req-acfd1734-2d36-42d9-886f-390fa9e9df0d tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:57.494861 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1bbe9cae-4973-4bf4-bfe0-e0d1b6f783c1 req-acfd1734-2d36-42d9-886f-390fa9e9df0d tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 945 time: 0.3325462
May 31 16:22:57.568941 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1bbe9cae-4973-4bf4-bfe0-e0d1b6f783c1 req-de857d6f-74ca-4c57-901e-3165e52fd101 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0732009
May 31 16:22:57.696850 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3550d8fb-8a93-4afc-82fb-4ac2e4a4979c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-14907233', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14793682'] for subnet, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:57.701500 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-49095cd1-5be6-4aaf-b0bd-1d2221186465 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:22:57.957183 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3550d8fb-8a93-4afc-82fb-4ac2e4a4979c admin admin] Checking segment: {'id': '54d58804-a1bf-4e3a-8d44-cdd8f5cc124a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 820, 'network_id': '52011424-acd2-4b1b-9a3c-ebda39ad09da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:22:57.957596 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3550d8fb-8a93-4afc-82fb-4ac2e4a4979c admin admin] Network hostable DHCP agents. Network: 52011424-acd2-4b1b-9a3c-ebda39ad09da, hostable agents: ['5c9859e8-5965-4c86-8b2b-8fab235cbf66'], hosted agents: [] {{(pid=91764) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 31 16:22:57.962846 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3550d8fb-8a93-4afc-82fb-4ac2e4a4979c admin admin] Pushing event updated for resources: {'Subnet': ['ID=e9f7875f-b5af-4ade-af35-3604ed5d2f89,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:22:57.974650 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-3550d8fb-8a93-4afc-82fb-4ac2e4a4979c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.273s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:22:57.994794 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-585f3b07-e3ec-4023-99fa-6d5b6ae94445 req-311bd0c7-faac-4d90-941a-f669a9a2f8c6 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:57.996344 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-585f3b07-e3ec-4023-99fa-6d5b6ae94445 req-311bd0c7-faac-4d90-941a-f669a9a2f8c6 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.2617326
May 31 16:22:58.024682 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3550d8fb-8a93-4afc-82fb-4ac2e4a4979c admin admin] Network 52011424-acd2-4b1b-9a3c-ebda39ad09da is scheduled to be hosted by DHCP agent 5c9859e8-5965-4c86-8b2b-8fab235cbf66 with binding_index 1 {{(pid=91764) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 31 16:22:58.052496 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-3550d8fb-8a93-4afc-82fb-4ac2e4a4979c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793814-1-iscsi, 52011424-acd2-4b1b-9a3c-ebda39ad09da) {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:22:58.065637 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6fc4500c-ce50-4e16-91c9-a818ae86fd38 None None] Network 52011424-acd2-4b1b-9a3c-ebda39ad09da requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:22:58.081071 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b6e7cfc-f01e-461f-9035-1af630b57623 req-ae166920-e7bc-410b-8903-ff61a82e58ea tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:58.082525 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2b6e7cfc-f01e-461f-9035-1af630b57623 req-ae166920-e7bc-410b-8903-ff61a82e58ea tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.2511876
May 31 16:22:58.128736 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3550d8fb-8a93-4afc-82fb-4ac2e4a4979c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:58.129899 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3550d8fb-8a93-4afc-82fb-4ac2e4a4979c admin admin] Notify callbacks [] for subnet, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:22:58.246806 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-585f3b07-e3ec-4023-99fa-6d5b6ae94445 req-4f52c3bc-6461-46fa-a3a0-87984e785e97 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2428122
May 31 16:22:58.251011 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-3550d8fb-8a93-4afc-82fb-4ac2e4a4979c admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 1.4500606
May 31 16:22:58.317695 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2b6e7cfc-f01e-461f-9035-1af630b57623 req-78ce096c-9dfc-455f-8d35-5784b180b4a9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2141831
May 31 16:22:58.355226 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-09fd64c3-e779-478b-81c2-a4f4635a2575 None None] Network 52011424-acd2-4b1b-9a3c-ebda39ad09da requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:22:59.028464 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b57abdc5-ff9b-430a-a1a7-c8ef5790def1 req-9e379752-4496-4ed1-8b35-fe64228fe21a tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:59.030060 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b57abdc5-ff9b-430a-a1a7-c8ef5790def1 req-9e379752-4496-4ed1-8b35-fe64228fe21a tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 945 time: 0.2058513
May 31 16:22:59.295183 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b57abdc5-ff9b-430a-a1a7-c8ef5790def1 req-7d078136-3928-4b57-9c51-faef283f4269 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1919732
May 31 16:22:59.346903 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0c48e2d-5f48-4f83-b630-be3e12234752 req-cfe28c89-2afc-449a-bb81-f13ea31387ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:59.353584 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e0c48e2d-5f48-4f83-b630-be3e12234752 req-cfe28c89-2afc-449a-bb81-f13ea31387ce service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=1739d3c0e2734c8a9af5c5291aac8e25&device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 1099 time: 0.3214099
May 31 16:22:59.808678 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0c48e2d-5f48-4f83-b630-be3e12234752 req-fdde0e51-821a-40af-944a-762195adc1ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:59.810389 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e0c48e2d-5f48-4f83-b630-be3e12234752 req-fdde0e51-821a-40af-944a-762195adc1ee service neutron] 10.222.0.63 "GET /v2.0/networks?id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 HTTP/1.1" status: 200  len: 920 time: 0.4385040
May 31 16:22:59.927034 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e0c48e2d-5f48-4f83-b630-be3e12234752 req-8c621495-bff1-4afc-8ac6-1649f935d608 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=f99df66c-c850-4d01-80ae-3d312eee69db HTTP/1.1" status: 200  len: 217 time: 0.0975993
May 31 16:22:59.938560 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7622bfaf-bb6b-432f-b34b-9cc4f301b97c req-0d70a543-5d36-4b6c-ba51-d7aef35c4f2a tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:22:59.940387 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7622bfaf-bb6b-432f-b34b-9cc4f301b97c req-0d70a543-5d36-4b6c-ba51-d7aef35c4f2a tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.3074346
May 31 16:23:00.138486 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7622bfaf-bb6b-432f-b34b-9cc4f301b97c req-cbde38d8-842e-4d62-bf52-6f193c689ca1 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1400957
May 31 16:23:00.151293 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0c48e2d-5f48-4f83-b630-be3e12234752 req-5184eaa6-46ff-4c39-a4a5-552f24422daf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:00.152832 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e0c48e2d-5f48-4f83-b630-be3e12234752 req-5184eaa6-46ff-4c39-a4a5-552f24422daf service neutron] 10.222.0.63 "GET /v2.0/subnets?id=b9c806fb-2a53-4445-8352-4336429eb043 HTTP/1.1" status: 200  len: 859 time: 0.2113721
May 31 16:23:00.244523 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e0c48e2d-5f48-4f83-b630-be3e12234752 req-fce4de78-5280-4013-8490-6a4c5f670733 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0762689
May 31 16:23:00.560341 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e0c48e2d-5f48-4f83-b630-be3e12234752 req-a72dea4d-3c1f-4bb8-adf5-e56c9e777cde service neutron] 10.222.0.63 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3014517
May 31 16:23:00.583985 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1342b472-e29f-491d-afab-aa78bd58f31d req-5ccb4210-7443-4029-8834-79fb94155abd tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:00.591095 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1342b472-e29f-491d-afab-aa78bd58f31d req-5ccb4210-7443-4029-8834-79fb94155abd tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 945 time: 0.2936072
May 31 16:23:00.640139 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fe40a43-30d6-4a42-826a-b4591e23c901 req-94d10276-fff1-4228-ac0a-5e74f5629924 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:00.641749 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3fe40a43-30d6-4a42-826a-b4591e23c901 req-94d10276-fff1-4228-ac0a-5e74f5629924 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.2348113
May 31 16:23:00.817083 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1342b472-e29f-491d-afab-aa78bd58f31d req-1b7fbe78-db85-4f79-8d04-cd6b661ed3dc tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2250240
May 31 16:23:00.849054 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3fe40a43-30d6-4a42-826a-b4591e23c901 req-cf1a9103-1136-493b-b789-7c3d440b29b6 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1989756
May 31 16:23:00.881196 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e0c48e2d-5f48-4f83-b630-be3e12234752 req-715e3d3a-85c7-4726-9bfe-c0db633f6907 service neutron] 10.222.0.63 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3069179
May 31 16:23:01.448760 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69664868-3070-4873-8c6f-824732d945d6 req-c42abdb5-267b-43c4-bcf6-9d7b16b3b7fc tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:01.450354 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-69664868-3070-4873-8c6f-824732d945d6 req-c42abdb5-267b-43c4-bcf6-9d7b16b3b7fc tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 945 time: 0.1831346
May 31 16:23:01.509634 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e23066-ad64-4a55-b263-11566d1fd707 req-6faf0f43-292f-4fd0-812e-29d965d830c8 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:01.510983 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f3e23066-ad64-4a55-b263-11566d1fd707 req-6faf0f43-292f-4fd0-812e-29d965d830c8 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.1988387
May 31 16:23:01.518995 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-69664868-3070-4873-8c6f-824732d945d6 req-93fed4f6-241e-45fc-9261-6b61765247f5 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0604870
May 31 16:23:01.575780 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f3e23066-ad64-4a55-b263-11566d1fd707 req-9649cfe9-947f-4c8d-98e7-1772565f46e4 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0556548
May 31 16:23:01.793608 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-9b33ab23-71c4-4470-8efa-1a21a06531d6 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:01.795208 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-9b33ab23-71c4-4470-8efa-1a21a06531d6 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/networks?id=52011424-acd2-4b1b-9a3c-ebda39ad09da HTTP/1.1" status: 200  len: 814 time: 0.1726019
May 31 16:23:01.811224 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-9a51af09-b237-429e-8470-84204743df37 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/quotas/8f633dd4e3b241db904e4505f98ebe62 HTTP/1.1" status: 200  len: 375 time: 0.0099292
May 31 16:23:01.866909 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-d37183a5-0842-43ac-94b7-82d0124dfbfa tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=8f633dd4e3b241db904e4505f98ebe62&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0485420
May 31 16:23:02.101964 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-f21f58d8-8d83-4469-b660-eac26c8ed595 service neutron] 10.222.0.43 "GET /v2.0/networks/52011424-acd2-4b1b-9a3c-ebda39ad09da?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2236147
May 31 16:23:02.389994 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4caca74-870d-40af-b15a-fee1b4060b3d req-adb0c4b7-d63a-47dc-81f4-03e096ec8f4a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:02.391344 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c4caca74-870d-40af-b15a-fee1b4060b3d req-adb0c4b7-d63a-47dc-81f4-03e096ec8f4a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.3444431
May 31 16:23:02.434240 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-17f50bfd-83ae-467a-a096-117421edf7d0 service neutron] 10.222.0.43 "GET /v2.0/networks/52011424-acd2-4b1b-9a3c-ebda39ad09da?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3225231
May 31 16:23:02.460137 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c4caca74-870d-40af-b15a-fee1b4060b3d req-9ab74ca5-e93e-4935-9893-ff1dd9e16040 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0557377
May 31 16:23:02.462052 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6d43e54-c4e7-4e6a-9ead-d044db069dba req-257e096e-742a-4919-a2e7-91de2a4ffd39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:02.463422 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b6d43e54-c4e7-4e6a-9ead-d044db069dba req-257e096e-742a-4919-a2e7-91de2a4ffd39 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=12203182731d4a61acb7fc5914aef425&device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 1099 time: 0.2403464
May 31 16:23:02.661358 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6d43e54-c4e7-4e6a-9ead-d044db069dba req-11eb3783-afe7-435f-b7fd-b546e5933029 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:02.665154 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b6d43e54-c4e7-4e6a-9ead-d044db069dba req-11eb3783-afe7-435f-b7fd-b546e5933029 service neutron] 10.222.0.63 "GET /v2.0/networks?id=be7d7603-734f-43bb-92a8-ed07a835aeb5 HTTP/1.1" status: 200  len: 917 time: 0.1812751
May 31 16:23:02.874533 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7484fb11-a3d4-4e8c-8fde-19375fd45bb8 req-bd22e205-bb7d-4f5c-9f7c-7ce30ac44240 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=15f6dcaf-fed7-4ab4-88fc-68d4a0db9938 HTTP/1.1" status: 200  len: 210 time: 0.1988313
May 31 16:23:02.921864 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b6d43e54-c4e7-4e6a-9ead-d044db069dba req-1a36bb84-6491-4dea-9137-d0d2c38bf50a service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=8cf870c7-bdf1-490f-adfa-61e27997bc91 HTTP/1.1" status: 200  len: 1002 time: 0.2444098
May 31 16:23:03.003093 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c18bfeb-72a1-4e0f-957b-fcfb0483a23b req-012c138b-8e7d-4f21-b748-52c31790a8fc tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:03.004847 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7c18bfeb-72a1-4e0f-957b-fcfb0483a23b req-012c138b-8e7d-4f21-b748-52c31790a8fc tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.2016923
May 31 16:23:03.015575 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6d43e54-c4e7-4e6a-9ead-d044db069dba req-ae054c6e-6b70-4c7e-81d4-c5c28abc6689 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:03.017044 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b6d43e54-c4e7-4e6a-9ead-d044db069dba req-ae054c6e-6b70-4c7e-81d4-c5c28abc6689 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=eb5363fe-ee39-4adc-b299-6098caad681d HTTP/1.1" status: 200  len: 855 time: 0.0887089
May 31 16:23:03.113015 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7c18bfeb-72a1-4e0f-957b-fcfb0483a23b req-f82830a7-ffeb-4e36-b7c2-caaff9f7730e tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0994003
May 31 16:23:03.147692 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6d43e54-c4e7-4e6a-9ead-d044db069dba req-68ab2c45-6a19-4b83-aa25-8bf008272da9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:03.149212 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b6d43e54-c4e7-4e6a-9ead-d044db069dba req-68ab2c45-6a19-4b83-aa25-8bf008272da9 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=be7d7603-734f-43bb-92a8-ed07a835aeb5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1165383
May 31 16:23:03.175566 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:23:03.346915 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b6d43e54-c4e7-4e6a-9ead-d044db069dba req-a9adebfc-204a-4ee2-86b0-7c82adb005fc service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1713779
May 31 16:23:03.513967 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b6d43e54-c4e7-4e6a-9ead-d044db069dba req-fdfee1ef-d456-44dd-a53b-01ebd3475904 service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1512158
May 31 16:23:03.701674 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38b3ed7a-0170-4287-8654-d4273fab9f2e req-c95f3722-0022-4823-9a8d-659af48c097e tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:03.703068 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-38b3ed7a-0170-4287-8654-d4273fab9f2e req-c95f3722-0022-4823-9a8d-659af48c097e tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.0905380
May 31 16:23:03.754623 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-38b3ed7a-0170-4287-8654-d4273fab9f2e req-e5a1845e-b3f6-4aec-aa71-4665824684c5 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0453181
May 31 16:23:04.052518 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1ccc2463-2329-4aa5-a746-20d129a05936 req-9a866956-4c3c-460f-b438-d9ac54a83b86 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=15f6dcaf-fed7-4ab4-88fc-68d4a0db9938 HTTP/1.1" status: 200  len: 210 time: 0.0526509
May 31 16:23:04.568307 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-996d5069-39fb-4e53-ae8a-d8b0a08f6a24 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:04.569831 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-996d5069-39fb-4e53-ae8a-d8b0a08f6a24 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.63 "GET /v2.0/networks?id=52011424-acd2-4b1b-9a3c-ebda39ad09da HTTP/1.1" status: 200  len: 814 time: 0.3458893
May 31 16:23:04.583162 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c10ad871-7d89-4956-a081-800690bded23 req-838d2bac-bcb3-448b-876e-8141606fc5e7 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:04.584683 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c10ad871-7d89-4956-a081-800690bded23 req-838d2bac-bcb3-448b-876e-8141606fc5e7 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.2026806
May 31 16:23:04.589546 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Request body: {'port': {'device_id': '15f6dcaf-fed7-4ab4-88fc-68d4a0db9938', 'network_id': '52011424-acd2-4b1b-9a3c-ebda39ad09da', 'admin_state_up': True, 'tenant_id': '8f633dd4e3b241db904e4505f98ebe62'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:23:04.806122 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c10ad871-7d89-4956-a081-800690bded23 req-1a176ea0-ec0f-41b7-9bef-06876d251f46 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2025111
May 31 16:23:04.875182 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:23:04.882897 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Usage tracker for resource:port and tenant:8f633dd4e3b241db904e4505f98ebe62 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:23:04.887376 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:23:04.898455 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:23:04.916616 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Made reservation on behalf of 8f633dd4e3b241db904e4505f98ebe62 for: {'port': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:23:04.924635 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:05.005603 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-9ff41892-7ab6-4dfc-ae92-496fc339f262 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:05.222522 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1df7f0cd-9913-4d3d-beab-c026bc2ddf69 req-8cd014ec-c022-40bf-b77a-9496654bea39 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:05.224236 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1df7f0cd-9913-4d3d-beab-c026bc2ddf69 req-8cd014ec-c022-40bf-b77a-9496654bea39 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 946 time: 0.2823775
May 31 16:23:05.273506 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Allocated IP 172.20.0.9 (52011424-acd2-4b1b-9a3c-ebda39ad09da/e9f7875f-b5af-4ade-af35-3604ed5d2f89/cef796b2-4c34-4037-848d-45c6d9f72fd4) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:23:05.303671 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1df7f0cd-9913-4d3d-beab-c026bc2ddf69 req-ccbebc2c-37ef-4c6b-81e6-0d08b68a488e tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0725329
May 31 16:23:05.519390 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-191f3171-07a5-46fb-adad-d3c8698df034 req-cb3985ed-5ced-4c51-9f62-5d6df8222e79 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=15f6dcaf-fed7-4ab4-88fc-68d4a0db9938 HTTP/1.1" status: 200  len: 210 time: 0.0728619
May 31 16:23:05.588427 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:05.632967 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:05.640405 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:05.718221 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Network 52011424-acd2-4b1b-9a3c-ebda39ad09da is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:23:05.723159 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:23:05.732370 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:23:05.758906 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Pushing event updated for resources: {'Port': ['ID=cef796b2-4c34-4037-848d-45c6d9f72fd4,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:05.783862 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:05.784180 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:05.784628 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:05.784999 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:05.785365 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:05.785755 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:05.786436 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:05.786611 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:05.786942 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:05.787300 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:05.787658 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:05.788021 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:05.794369 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:05.819260 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:05.819884 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:05.844859 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.63 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.2588909
May 31 16:23:05.864929 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Request body: {'port': {'device_id': '15f6dcaf-fed7-4ab4-88fc-68d4a0db9938', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79381'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:23:05.999684 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:06.364952 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 8cf870c7-bdf1-490f-adfa-61e27997bc91 no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:23:06.378319 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cef796b2-4c34-4037-848d-45c6d9f72fd4 {{(pid=91764) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:23:06.386297 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:06.407069 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.provisioning_blocks [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Transition to ACTIVE for port object cef796b2-4c34-4037-848d-45c6d9f72fd4 will not be triggered until provisioned by entity L2. {{(pid=91764) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:23:06.415470 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:06.431585 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:06.500913 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:06.550726 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '236769ac-e375-4497-9fe7-7425ccc79d09', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8cf870c7-bdf1-490f-adfa-61e27997bc91'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:23:06.554684 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fb462d20-277c-442e-8de3-a585eb90e316" -d '{"events": [{"server_uuid": "236769ac-e375-4497-9fe7-7425ccc79d09", "name": "network-vif-unplugged", "status": "completed", "tag": "8cf870c7-bdf1-490f-adfa-61e27997bc91"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:23:06.564140 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 8cf870c7-bdf1-490f-adfa-61e27997bc91, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=8cf870c7-bdf1-490f-adfa-61e27997bc91,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:23:06.570727 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:06.576790 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:06.690286 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=8cf870c7-bdf1-490f-adfa-61e27997bc91,revision_number=8']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:06.693862 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:06.763522 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Pushing event updated for resources: {'Port': ['ID=cef796b2-4c34-4037-848d-45c6d9f72fd4,revision_number=2']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:06.776987 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.345s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:06.818637 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f34163-82b4-4b38-a1c0-3ab66627c82a req-9168d292-4ad5-4389-ad4d-350b7c3db9a6 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:06.820354 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b8f34163-82b4-4b38-a1c0-3ab66627c82a req-9168d292-4ad5-4389-ad4d-350b7c3db9a6 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.3504994
May 31 16:23:06.864502 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Attempting to bind port cef796b2-4c34-4037-848d-45c6d9f72fd4 on host hv-cinder-79381 for vnic_type normal with profile  {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:23:06.864817 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Attempting to bind port cef796b2-4c34-4037-848d-45c6d9f72fd4 by drivers openvswitch,hyperv on host hv-cinder-79381 at level 0 using segments [{'id': '54d58804-a1bf-4e3a-8d44-cdd8f5cc124a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 820, 'network_id': '52011424-acd2-4b1b-9a3c-ebda39ad09da'}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:23:06.865146 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Attempting to bind port cef796b2-4c34-4037-848d-45c6d9f72fd4 on network 52011424-acd2-4b1b-9a3c-ebda39ad09da {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:23:06.881304 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Port cef796b2-4c34-4037-848d-45c6d9f72fd4 on network 52011424-acd2-4b1b-9a3c-ebda39ad09da not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79381 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 31 16:23:06.881906 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Attempting to bind port cef796b2-4c34-4037-848d-45c6d9f72fd4 on network 52011424-acd2-4b1b-9a3c-ebda39ad09da {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:23:06.898401 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Checking agent: {'id': '4bed2638-4d91-4afb-bf81-aacca8584621', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79381', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'started_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 22, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:23:06.898776 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Checking segment: {'id': '54d58804-a1bf-4e3a-8d44-cdd8f5cc124a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 820, 'network_id': '52011424-acd2-4b1b-9a3c-ebda39ad09da'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:23:06.899165 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Bound using segment: {'id': '54d58804-a1bf-4e3a-8d44-cdd8f5cc124a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 820, 'network_id': '52011424-acd2-4b1b-9a3c-ebda39ad09da'} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:23:06.899610 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Bound port: cef796b2-4c34-4037-848d-45c6d9f72fd4, host: hv-cinder-79381, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '54d58804-a1bf-4e3a-8d44-cdd8f5cc124a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 820, 'network_id': '52011424-acd2-4b1b-9a3c-ebda39ad09da'}}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:23:06.899975 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:06.920605 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b8f34163-82b4-4b38-a1c0-3ab66627c82a req-1b254818-2ef5-40e0-960c-15b0fbebddf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0812516
May 31 16:23:06.994556 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Mon, 31 May 2021 16:23:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ea3c8ba5-70e0-490b-a538-b8fbd84d55c7 x-openstack-request-id: req-ea3c8ba5-70e0-490b-a538-b8fbd84d55c7 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:23:06.995163 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "236769ac-e375-4497-9fe7-7425ccc79d09", "name": "network-vif-unplugged", "status": "completed", "tag": "8cf870c7-bdf1-490f-adfa-61e27997bc91", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:23:06.995631 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-ea3c8ba5-70e0-490b-a538-b8fbd84d55c7 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:23:06.996246 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '236769ac-e375-4497-9fe7-7425ccc79d09', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8cf870c7-bdf1-490f-adfa-61e27997bc91', 'code': 200}
May 31 16:23:07.050721 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70f8fd4a-bf04-497f-8bb9-a3cdc01df49b req-357ca384-f52a-4b47-91f7-ae9b13ba9840 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:07.051447 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-70f8fd4a-bf04-497f-8bb9-a3cdc01df49b req-357ca384-f52a-4b47-91f7-ae9b13ba9840 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Synchronizing usage tracker for tenant:8f633dd4e3b241db904e4505f98ebe62 on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:23:07.102828 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-70f8fd4a-bf04-497f-8bb9-a3cdc01df49b req-357ca384-f52a-4b47-91f7-ae9b13ba9840 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Unset dirty status for tenant:8f633dd4e3b241db904e4505f98ebe62 on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:23:07.103979 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-70f8fd4a-bf04-497f-8bb9-a3cdc01df49b req-357ca384-f52a-4b47-91f7-ae9b13ba9840 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=15f6dcaf-fed7-4ab4-88fc-68d4a0db9938 HTTP/1.1" status: 200  len: 943 time: 0.3908494
May 31 16:23:07.138165 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] For port cef796b2-4c34-4037-848d-45c6d9f72fd4, host hv-cinder-79381, cleared binding levels {{(pid=91764) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:23:07.158305 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] For port cef796b2-4c34-4037-848d-45c6d9f72fd4, host hv-cinder-79381, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=cef796b2-4c34-4037-848d-45c6d9f72fd4,segment=NetworkSegment(54d58804-a1bf-4e3a-8d44-cdd8f5cc124a),segment_id=54d58804-a1bf-4e3a-8d44-cdd8f5cc124a)] {{(pid=91764) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:23:07.165264 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:07.169462 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:07.207414 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-70f8fd4a-bf04-497f-8bb9-a3cdc01df49b req-bdc69735-b4a5-4954-9998-287aefe07354 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0973032
May 31 16:23:07.244079 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:07.244690 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:07.246090 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] 10.222.0.63 "PUT /v2.0/ports/cef796b2-4c34-4037-848d-45c6d9f72fd4 HTTP/1.1" status: 200  len: 1093 time: 1.3881543
May 31 16:23:07.246617 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '15f6dcaf-fed7-4ab4-88fc-68d4a0db9938', 'tag': 'cef796b2-4c34-4037-848d-45c6d9f72fd4'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:23:07.249184 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c558fdcb-7e8b-452b-8611-aaf8ed144f46" -d '{"events": [{"name": "network-changed", "server_uuid": "15f6dcaf-fed7-4ab4-88fc-68d4a0db9938", "tag": "cef796b2-4c34-4037-848d-45c6d9f72fd4"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:23:07.271267 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Pushing event updated for resources: {'Port': ['ID=cef796b2-4c34-4037-848d-45c6d9f72fd4,revision_number=3']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:07.276758 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:07.342168 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:23:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5c62fde0-395b-498c-ac2d-c224226e9ddb x-openstack-request-id: req-5c62fde0-395b-498c-ac2d-c224226e9ddb {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:23:07.342465 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "15f6dcaf-fed7-4ab4-88fc-68d4a0db9938", "tag": "cef796b2-4c34-4037-848d-45c6d9f72fd4", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:23:07.342752 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-5c62fde0-395b-498c-ac2d-c224226e9ddb {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:23:07.343179 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '15f6dcaf-fed7-4ab4-88fc-68d4a0db9938', 'tag': 'cef796b2-4c34-4037-848d-45c6d9f72fd4', 'status': 'completed', 'code': 200}
May 31 16:23:07.388999 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-f9f47626-e3c8-41ec-8d94-790453f8f4d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:07.390510 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-f9f47626-e3c8-41ec-8d94-790453f8f4d3 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=8f633dd4e3b241db904e4505f98ebe62&device_id=15f6dcaf-fed7-4ab4-88fc-68d4a0db9938 HTTP/1.1" status: 200  len: 1096 time: 0.0895877
May 31 16:23:07.494891 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-8790499c-d2f5-4705-a328-fd949498a86a service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cef796b2-4c34-4037-848d-45c6d9f72fd4 HTTP/1.1" status: 200  len: 217 time: 0.0655515
May 31 16:23:07.562618 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-598d358a-dee4-44eb-bdad-6f2d03cf2edb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:07.564168 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-598d358a-dee4-44eb-bdad-6f2d03cf2edb service neutron] 10.222.0.63 "GET /v2.0/subnets?id=e9f7875f-b5af-4ade-af35-3604ed5d2f89 HTTP/1.1" status: 200  len: 854 time: 0.0618801
May 31 16:23:07.632239 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-d9354767-ac00-412d-a533-1ec94e516235 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=52011424-acd2-4b1b-9a3c-ebda39ad09da&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0560668
May 31 16:23:07.801969 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-2dd9f089-2dca-44f4-84f7-bf1490df7477 service neutron] 10.222.0.63 "GET /v2.0/networks/52011424-acd2-4b1b-9a3c-ebda39ad09da?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1435597
May 31 16:23:07.905905 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:08.016144 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-377d09f8-9ba3-401f-9347-960660dd6d4c req-ee143c43-32e6-4b4f-af30-6c8a989abc8d service neutron] 10.222.0.63 "GET /v2.0/networks/52011424-acd2-4b1b-9a3c-ebda39ad09da?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2017667
May 31 16:23:08.221498 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0c3e2116-1ef3-49d4-a4ce-5e48f852fbba None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:08.254723 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a19cbcf-41da-4735-ba6b-b036bc301b84 req-5f886f7c-ae4b-4fd3-9306-f8d4a7abed52 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:08.256282 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2a19cbcf-41da-4735-ba6b-b036bc301b84 req-5f886f7c-ae4b-4fd3-9306-f8d4a7abed52 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.2047343
May 31 16:23:08.262320 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c558fdcb-7e8b-452b-8611-aaf8ed144f46 req-40774791-4dca-4533-af10-84dc2b53f8c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:08.263696 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c558fdcb-7e8b-452b-8611-aaf8ed144f46 req-40774791-4dca-4533-af10-84dc2b53f8c1 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=8f633dd4e3b241db904e4505f98ebe62&device_id=15f6dcaf-fed7-4ab4-88fc-68d4a0db9938 HTTP/1.1" status: 200  len: 1096 time: 0.1453202
May 31 16:23:08.425829 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2a19cbcf-41da-4735-ba6b-b036bc301b84 req-4bda2e1e-7516-42c9-a5b8-b7673cb0e07d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1611640
May 31 16:23:08.492418 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c558fdcb-7e8b-452b-8611-aaf8ed144f46 req-97a01d37-246e-461b-b407-ef12d9067b09 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:08.493870 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c558fdcb-7e8b-452b-8611-aaf8ed144f46 req-97a01d37-246e-461b-b407-ef12d9067b09 service neutron] 10.222.0.63 "GET /v2.0/networks?id=52011424-acd2-4b1b-9a3c-ebda39ad09da HTTP/1.1" status: 200  len: 915 time: 0.2059157
May 31 16:23:08.509047 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cc67a3a-49d7-4dae-ba56-2d797a32f32a req-f534c834-f21d-41bb-b0dc-c3688ac4c8cd tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:08.510521 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4cc67a3a-49d7-4dae-ba56-2d797a32f32a req-f534c834-f21d-41bb-b0dc-c3688ac4c8cd tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=15f6dcaf-fed7-4ab4-88fc-68d4a0db9938 HTTP/1.1" status: 200  len: 943 time: 0.1840804
May 31 16:23:08.592096 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c558fdcb-7e8b-452b-8611-aaf8ed144f46 req-2c551b1d-b3c2-4e2c-8d6f-6b55112d2c0b service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cef796b2-4c34-4037-848d-45c6d9f72fd4 HTTP/1.1" status: 200  len: 217 time: 0.0806296
May 31 16:23:08.653572 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4cc67a3a-49d7-4dae-ba56-2d797a32f32a req-a25f2ddd-ce92-4ddf-9f59-69c1e68b0fbc tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0882292
May 31 16:23:08.685310 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c558fdcb-7e8b-452b-8611-aaf8ed144f46 req-bbd478c6-894c-4121-ae30-088d3fcf869b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:08.686919 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c558fdcb-7e8b-452b-8611-aaf8ed144f46 req-bbd478c6-894c-4121-ae30-088d3fcf869b service neutron] 10.222.0.63 "GET /v2.0/subnets?id=e9f7875f-b5af-4ade-af35-3604ed5d2f89 HTTP/1.1" status: 200  len: 854 time: 0.0784829
May 31 16:23:08.746173 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c558fdcb-7e8b-452b-8611-aaf8ed144f46 req-c6e4154f-2958-435e-9fd1-72869d7c5502 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=52011424-acd2-4b1b-9a3c-ebda39ad09da&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0505824
May 31 16:23:08.926593 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c558fdcb-7e8b-452b-8611-aaf8ed144f46 req-5ca75e14-c118-48d2-8bc5-cb30802aa407 service neutron] 10.222.0.63 "GET /v2.0/networks/52011424-acd2-4b1b-9a3c-ebda39ad09da?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1700237
May 31 16:23:09.150218 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:09.194523 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c558fdcb-7e8b-452b-8611-aaf8ed144f46 req-5d350d0c-131e-4ba7-9d17-5412f3c9d5c0 service neutron] 10.222.0.63 "GET /v2.0/networks/52011424-acd2-4b1b-9a3c-ebda39ad09da?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2430689
May 31 16:23:09.724850 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eafa7042-51d9-4919-a792-29b672ff40f5 req-46f2d08f-2d51-4cf3-9e84-dcee7be6ccca tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:09.726613 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-eafa7042-51d9-4919-a792-29b672ff40f5 req-46f2d08f-2d51-4cf3-9e84-dcee7be6ccca tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.0859230
May 31 16:23:09.838536 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-eafa7042-51d9-4919-a792-29b672ff40f5 req-aa47649a-6fee-4118-8821-fde1467a9545 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1051483
May 31 16:23:09.882073 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f09284c-37f3-47ba-839e-7905d93386da req-dfec58c8-495d-46d0-8cf0-0ef37316d29b tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:09.886589 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8f09284c-37f3-47ba-839e-7905d93386da req-dfec58c8-495d-46d0-8cf0-0ef37316d29b tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=15f6dcaf-fed7-4ab4-88fc-68d4a0db9938 HTTP/1.1" status: 200  len: 943 time: 0.1209047
May 31 16:23:09.934730 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8f09284c-37f3-47ba-839e-7905d93386da req-767f31b0-3001-4310-892b-a55a34b67073 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0447965
May 31 16:23:10.002037 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 33616) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:23:10.126417 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-33b09aad-d9e2-4dd5-98c2-82ab8cdf8630 req-9747e67a-5d47-43b9-99e5-c49bedad8674 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1226375
May 31 16:23:10.403706 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 8cf870c7-bdf1-490f-adfa-61e27997bc91 no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:23:10.850861 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:11.080040 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebcc795b-a646-4376-b2ef-b80f3fcf5fed req-da8e35af-f4c4-424b-bbff-e857dab5e3e1 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:11.081930 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ebcc795b-a646-4376-b2ef-b80f3fcf5fed req-da8e35af-f4c4-424b-bbff-e857dab5e3e1 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.1097584
May 31 16:23:11.187322 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ebcc795b-a646-4376-b2ef-b80f3fcf5fed req-c9c343ad-9ac9-4cca-bd93-5bdd662c159b tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0655537
May 31 16:23:11.216886 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb512db2-54af-46a0-b7a9-0dda45d61adc req-317da6dc-935a-4654-8faf-65d8db3c5b1a tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:11.218407 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-fb512db2-54af-46a0-b7a9-0dda45d61adc req-317da6dc-935a-4654-8faf-65d8db3c5b1a tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=15f6dcaf-fed7-4ab4-88fc-68d4a0db9938 HTTP/1.1" status: 200  len: 943 time: 0.1348951
May 31 16:23:11.270985 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-fb512db2-54af-46a0-b7a9-0dda45d61adc req-58c40228-f9fb-4f2b-b7f4-d8e16f3896f2 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0458782
May 31 16:23:12.186987 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7aec96fd-46a3-4a82-836b-b376789aa07c req-bade4083-b170-42be-9d1d-29cb3311e906 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0746682
May 31 16:23:12.401564 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aec96fd-46a3-4a82-836b-b376789aa07c req-982f3424-13da-4d53-b29f-f4474bce45a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:12.401564 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7aec96fd-46a3-4a82-836b-b376789aa07c req-982f3424-13da-4d53-b29f-f4474bce45a2 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=1739d3c0e2734c8a9af5c5291aac8e25&device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 1098 time: 0.1843805
May 31 16:23:12.445789 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device cef796b2-4c34-4037-848d-45c6d9f72fd4 details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:23:12.592790 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port cef796b2-4c34-4037-848d-45c6d9f72fd4, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=cef796b2-4c34-4037-848d-45c6d9f72fd4,segment=NetworkSegment(54d58804-a1bf-4e3a-8d44-cdd8f5cc124a),segment_id=54d58804-a1bf-4e3a-8d44-cdd8f5cc124a)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:23:12.611539 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14a850d3-4bf1-41a5-bb09-c371a351d5e1 req-3db0ff71-1e48-4828-bc1a-2a7ad1cc0c6b tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:12.613187 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-14a850d3-4bf1-41a5-bb09-c371a351d5e1 req-3db0ff71-1e48-4828-bc1a-2a7ad1cc0c6b tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.3049886
May 31 16:23:12.615052 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': 'cef796b2-4c34-4037-848d-45c6d9f72fd4', 'network_id': '52011424-acd2-4b1b-9a3c-ebda39ad09da', 'port_id': 'cef796b2-4c34-4037-848d-45c6d9f72fd4', 'mac_address': 'fa:16:3e:44:4a:59', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 820, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e9f7875f-b5af-4ade-af35-3604ed5d2f89', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:23:12.638415 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aec96fd-46a3-4a82-836b-b376789aa07c req-24371765-2747-44eb-bc6d-eeae44202a54 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:12.639820 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7aec96fd-46a3-4a82-836b-b376789aa07c req-24371765-2747-44eb-bc6d-eeae44202a54 service neutron] 10.222.0.63 "GET /v2.0/networks?id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 HTTP/1.1" status: 200  len: 920 time: 0.1985390
May 31 16:23:12.656944 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6bf1ac2-1fe2-477b-9c99-704cf107ae6b req-5c69d40c-850a-40f3-a336-63ab44b56094 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:12.659210 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d6bf1ac2-1fe2-477b-9c99-704cf107ae6b req-5c69d40c-850a-40f3-a336-63ab44b56094 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=15f6dcaf-fed7-4ab4-88fc-68d4a0db9938 HTTP/1.1" status: 200  len: 943 time: 0.2541797
May 31 16:23:12.689479 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:12.708780 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cef796b2-4c34-4037-848d-45c6d9f72fd4 {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:23:12.726433 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port cef796b2-4c34-4037-848d-45c6d9f72fd4, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=cef796b2-4c34-4037-848d-45c6d9f72fd4,segment=NetworkSegment(54d58804-a1bf-4e3a-8d44-cdd8f5cc124a),segment_id=54d58804-a1bf-4e3a-8d44-cdd8f5cc124a)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:23:12.730453 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:12.732254 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-f19e1463-1c08-4ed2-be05-108c08d82783 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:12.747894 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7aec96fd-46a3-4a82-836b-b376789aa07c req-e5732660-a566-4a58-b3c1-524b3db0b8e7 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=24196a14-22d0-4d09-9fa7-16d524809d92 HTTP/1.1" status: 200  len: 217 time: 0.0988915
May 31 16:23:12.769042 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-14a850d3-4bf1-41a5-bb09-c371a351d5e1 req-281b31f3-1669-47fd-9cb7-3a044f05c070 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1474671
May 31 16:23:12.806113 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=cef796b2-4c34-4037-848d-45c6d9f72fd4,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:12.809609 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:12.818305 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d6bf1ac2-1fe2-477b-9c99-704cf107ae6b req-c74cd481-83ec-4b53-bc43-e63615d2459e tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1055493
May 31 16:23:12.848631 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aec96fd-46a3-4a82-836b-b376789aa07c req-b3ffe1c3-9009-4780-8579-e5fe3dee934c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:12.850046 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7aec96fd-46a3-4a82-836b-b376789aa07c req-b3ffe1c3-9009-4780-8579-e5fe3dee934c service neutron] 10.222.0.63 "GET /v2.0/subnets?id=b9c806fb-2a53-4445-8352-4336429eb043 HTTP/1.1" status: 200  len: 859 time: 0.0772707
May 31 16:23:12.902852 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7aec96fd-46a3-4a82-836b-b376789aa07c req-466a4622-e618-4741-bb2c-d29b0155db36 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0424213
May 31 16:23:13.045559 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7aec96fd-46a3-4a82-836b-b376789aa07c req-0eca064d-6332-42b0-91bd-3ccf5c594627 service neutron] 10.222.0.63 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1349401
May 31 16:23:13.178721 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['cef796b2-4c34-4037-848d-45c6d9f72fd4'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:23:13.201904 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7aec96fd-46a3-4a82-836b-b376789aa07c req-f0a1ba05-4b96-4c67-95fb-ab8d6a8e0a03 service neutron] 10.222.0.63 "GET /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1424654
May 31 16:23:14.082700 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f08c73a-efac-4b43-9b35-f4c1731ca51b req-d473658e-3562-4c7d-aee3-532dace7fd93 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:14.084464 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6f08c73a-efac-4b43-9b35-f4c1731ca51b req-d473658e-3562-4c7d-aee3-532dace7fd93 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.1937637
May 31 16:23:14.097123 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bab4fc2a-fc26-47f2-a234-d2545be79d0f req-a1736433-1c0b-46ba-8269-8a2b656b48e3 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:14.098633 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bab4fc2a-fc26-47f2-a234-d2545be79d0f req-a1736433-1c0b-46ba-8269-8a2b656b48e3 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=15f6dcaf-fed7-4ab4-88fc-68d4a0db9938 HTTP/1.1" status: 200  len: 944 time: 0.1468382
May 31 16:23:14.177973 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6f08c73a-efac-4b43-9b35-f4c1731ca51b req-df10fe88-328b-4dac-8f6d-13f45c5d05c0 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0783179
May 31 16:23:14.182963 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bab4fc2a-fc26-47f2-a234-d2545be79d0f req-a79330f6-519a-4f59-9537-386373746216 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0698183
May 31 16:23:15.560466 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c8b4566-8132-42e6-9b5c-3d367c15cf9e req-949ad773-b14f-4444-b7aa-119016940072 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:15.562212 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0c8b4566-8132-42e6-9b5c-3d367c15cf9e req-949ad773-b14f-4444-b7aa-119016940072 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.1211762
May 31 16:23:15.574499 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1728ae02-0cd0-4105-9dcb-130915f1788b req-29306f59-03c5-4fcf-a929-a1840d7a1734 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:15.576059 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1728ae02-0cd0-4105-9dcb-130915f1788b req-29306f59-03c5-4fcf-a929-a1840d7a1734 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=15f6dcaf-fed7-4ab4-88fc-68d4a0db9938 HTTP/1.1" status: 200  len: 944 time: 0.2475560
May 31 16:23:15.662365 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0c8b4566-8132-42e6-9b5c-3d367c15cf9e req-c86526f6-3d39-4483-ae32-8466c2917b07 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0844634
May 31 16:23:15.668327 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1728ae02-0cd0-4105-9dcb-130915f1788b req-03e30399-9a78-499e-a0e1-c9861db2a982 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0774534
May 31 16:23:15.947465 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86b03e85-93b4-49a3-84d0-a5a2e072e62d req-af35a6bb-eee6-4ce5-8fa0-e17f8bf153e5 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:15.949039 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-86b03e85-93b4-49a3-84d0-a5a2e072e62d req-af35a6bb-eee6-4ce5-8fa0-e17f8bf153e5 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 945 time: 0.1304979
May 31 16:23:15.999926 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-86b03e85-93b4-49a3-84d0-a5a2e072e62d req-57d68edf-23f0-43fb-b730-9302f3995d62 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0439925
May 31 16:23:16.029071 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 33694) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:23:16.222174 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5509fff5-74ef-4226-8a4e-db379b5d6246 tempest-TestMinimumBasicScenario-1079969229 tempest-TestMinimumBasicScenario-1079969229-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:16.223680 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-5509fff5-74ef-4226-8a4e-db379b5d6246 tempest-TestMinimumBasicScenario-1079969229 tempest-TestMinimumBasicScenario-1079969229-project-admin] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 1093 time: 0.1936398
May 31 16:23:16.226568 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 33700) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:23:16.231740 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Request body: {'floatingip': {'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'port_id': '747cd83a-69bc-48d9-8ba9-e9638b7be825', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'fixed_ip_address': '172.20.0.5'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:23:16.238310 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:23:16.242171 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Usage tracker for resource:floatingip and tenant:8e66b29e29094a429643e0308704753b is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:23:16.245023 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:23:16.251428 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:23:16.263506 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for floatingip, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:16.427022 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:16.475590 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device cef796b2-4c34-4037-848d-45c6d9f72fd4 up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:23:16.586721 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning for port cef796b2-4c34-4037-848d-45c6d9f72fd4 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:23:16.596529 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port cef796b2-4c34-4037-848d-45c6d9f72fd4 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:23:16.596980 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:16.617194 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Allocated IP 172.27.0.194 (00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c/96709d85-d0fe-4cf8-b232-eaf6b143ebe6/04cf4a3a-286e-44a1-84ca-5915151b9e43) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:23:16.739311 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:16.782090 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '15f6dcaf-fed7-4ab4-88fc-68d4a0db9938', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cef796b2-4c34-4037-848d-45c6d9f72fd4'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:23:16.785389 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3e92672d-eedd-4230-ac81-10338846541a" -d '{"events": [{"server_uuid": "15f6dcaf-fed7-4ab4-88fc-68d4a0db9938", "name": "network-vif-plugged", "status": "completed", "tag": "cef796b2-4c34-4037-848d-45c6d9f72fd4"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:23:16.792568 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:16.805579 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port cef796b2-4c34-4037-848d-45c6d9f72fd4, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=cef796b2-4c34-4037-848d-45c6d9f72fd4,segment=NetworkSegment(54d58804-a1bf-4e3a-8d44-cdd8f5cc124a),segment_id=54d58804-a1bf-4e3a-8d44-cdd8f5cc124a)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:23:16.814452 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:16.817133 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:16.933020 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=cef796b2-4c34-4037-848d-45c6d9f72fd4,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:16.936518 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:16.975623 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:16.988094 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-4065e913-5580-4092-9ee0-acd4b8fbe4cf service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:17.080974 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:23:17.094632 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:23:17.102502 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c4f264d-c3fb-4627-811d-99b50a9efe5c req-3c075251-3ebb-4fa4-89e9-a5f96099d3d5 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:17.104089 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2c4f264d-c3fb-4627-811d-99b50a9efe5c req-3c075251-3ebb-4fa4-89e9-a5f96099d3d5 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=15f6dcaf-fed7-4ab4-88fc-68d4a0db9938 HTTP/1.1" status: 200  len: 945 time: 0.3040166
May 31 16:23:17.104904 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:23:17.181804 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Pushing event updated for resources: {'Port': ['ID=04cf4a3a-286e-44a1-84ca-5915151b9e43,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:17.194076 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.211s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:17.214268 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad1e69ba-99a2-4a47-9f5c-bd29265b6271 req-a842db5c-2d23-47f4-a5c6-52f5d84bd9f3 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:17.215827 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ad1e69ba-99a2-4a47-9f5c-bd29265b6271 req-a842db5c-2d23-47f4-a5c6-52f5d84bd9f3 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.3435683
May 31 16:23:17.298241 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2c4f264d-c3fb-4627-811d-99b50a9efe5c req-d0751870-e8a0-4d02-9c0a-25616d4f9924 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1562948
May 31 16:23:17.361883 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:23:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5aa759e1-82eb-4187-b0c6-bec48692b761 x-openstack-request-id: req-5aa759e1-82eb-4187-b0c6-bec48692b761 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:23:17.362346 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "15f6dcaf-fed7-4ab4-88fc-68d4a0db9938", "name": "network-vif-plugged", "status": "completed", "tag": "cef796b2-4c34-4037-848d-45c6d9f72fd4", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:23:17.363692 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-5aa759e1-82eb-4187-b0c6-bec48692b761 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:23:17.364125 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '15f6dcaf-fed7-4ab4-88fc-68d4a0db9938', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cef796b2-4c34-4037-848d-45c6d9f72fd4', 'code': 200}
May 31 16:23:17.377692 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ad1e69ba-99a2-4a47-9f5c-bd29265b6271 req-8ee82474-cbb5-4071-bba2-16595048895a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1514261
May 31 16:23:18.002679 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92a103a9-4c64-429e-ba2b-7db0b9f1c103 req-9998d626-f5e5-4832-a285-acf5fabb60b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:18.004048 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-92a103a9-4c64-429e-ba2b-7db0b9f1c103 req-9998d626-f5e5-4832-a285-acf5fabb60b8 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=15f6dcaf-fed7-4ab4-88fc-68d4a0db9938 HTTP/1.1" status: 200  len: 1098 time: 0.4004831
May 31 16:23:18.079005 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-92a103a9-4c64-429e-ba2b-7db0b9f1c103 req-54fd8cf7-0765-4e91-aabc-25f77cba830c service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0654685
May 31 16:23:18.091819 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:18.224751 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:18.498334 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for port, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:18.505831 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:18.511196 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-592dbc24-abf1-4186-ba3b-95441d90b4c7 tempest-DeleteServersTestJSON-627160738 tempest-DeleteServersTestJSON-627160738-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:18.692619 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Pushing event updated for resources: {'Port': ['ID=04cf4a3a-286e-44a1-84ca-5915151b9e43,revision_number=2']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:18.699126 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:18.712596 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16621821'] for floatingip, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:18.789666 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f116be9-493e-423d-80f0-718c44c261f1 req-f49c7e02-96d1-4c1e-bba1-ab4a977e7400 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:18.791181 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0f116be9-493e-423d-80f0-718c44c261f1 req-f49c7e02-96d1-4c1e-bba1-ab4a977e7400 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=15f6dcaf-fed7-4ab4-88fc-68d4a0db9938 HTTP/1.1" status: 200  len: 945 time: 0.3486483
May 31 16:23:18.901554 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c00be8bd-6837-46cd-96b6-a11cfe35c78a req-004add79-230a-431b-81fa-3f1801d0857d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:18.902966 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c00be8bd-6837-46cd-96b6-a11cfe35c78a req-004add79-230a-431b-81fa-3f1801d0857d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.3565710
May 31 16:23:18.966043 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0f116be9-493e-423d-80f0-718c44c261f1 req-66d53507-47aa-4a59-9bea-6efe84900d95 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1635048
May 31 16:23:19.000566 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.db.l3_db [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Floating IP 0bdaa7f7-9a86-4bcf-a99d-ff3f1902bcc0 associated. External IP: 172.27.0.194, port: 747cd83a-69bc-48d9-8ba9-e9638b7be825.
May 31 16:23:19.065923 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c00be8bd-6837-46cd-96b6-a11cfe35c78a req-68fb497d-bc94-4585-ab1d-23b199295928 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1444263
May 31 16:23:19.465625 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Router 7928d30e-0100-4eb5-9431-cf404997bd15 has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91764) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:23:19.603304 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:19.719206 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91764) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:23:19.730244 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4755077c-2578-445f-a277-9bc160814c55 None None] Sync routers for ids ['7928d30e-0100-4eb5-9431-cf404997bd15'] in dv-cinder-793814-1-iscsi {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:23:19.740456 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4755077c-2578-445f-a277-9bc160814c55 None None] Routers {'7928d30e-0100-4eb5-9431-cf404997bd15'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:23:19.741033 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-4755077c-2578-445f-a277-9bc160814c55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426b00040>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:23:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['7928d30e-0100-4eb5-9431-cf404997bd15'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:23:19.760045 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33b09aad-d9e2-4dd5-98c2-82ab8cdf8630 req-cd5f5e98-49b7-4996-90a1-4504be4d0265 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:19.761503 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-33b09aad-d9e2-4dd5-98c2-82ab8cdf8630 req-cd5f5e98-49b7-4996-90a1-4504be4d0265 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09&tenant_id=12203182731d4a61acb7fc5914aef425 HTTP/1.1" status: 200  len: 1097 time: 0.1421506
May 31 16:23:19.779994 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for floatingip, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:19.912595 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 3.6847916
May 31 16:23:19.915625 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 33752) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:23:19.923734 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1685154645', 'description': 'tempest-secgroup-smoke-1685154645 description', 'project_id': '8e66b29e29094a429643e0308704753b'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:23:19.929683 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-4755077c-2578-445f-a277-9bc160814c55 None None] Set router 7928d30e-0100-4eb5-9431-cf404997bd15 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:23:19.931396 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:23:19.935907 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Usage tracker for resource:security_group and tenant:8e66b29e29094a429643e0308704753b is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:23:19.939450 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:23:19.943629 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1d2436ad-b7ce-4d4c-851a-544a84fe2ef5', 'tag': '747cd83a-69bc-48d9-8ba9-e9638b7be825'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:23:19.945812 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dacceb71-a008-4171-919f-7af7b3660689" -d '{"events": [{"name": "network-changed", "server_uuid": "1d2436ad-b7ce-4d4c-851a-544a84fe2ef5", "tag": "747cd83a-69bc-48d9-8ba9-e9638b7be825"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:23:19.948297 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:23:19.967550 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:19.987254 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33b09aad-d9e2-4dd5-98c2-82ab8cdf8630 req-43de96ac-d026-431c-b24e-f9fa977ec491 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:19.988843 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-33b09aad-d9e2-4dd5-98c2-82ab8cdf8630 req-43de96ac-d026-431c-b24e-f9fa977ec491 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=12203182731d4a61acb7fc5914aef425&device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 1097 time: 0.1677029
May 31 16:23:20.040273 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:23:20.047676 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Usage tracker for resource:security_group_rule and tenant:8e66b29e29094a429643e0308704753b is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:23:20.054010 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:23:20.056946 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4eca5fba-9839-46f9-8a8b-5d13338789a5 req-c7133bfc-7c60-40b0-9552-1d39ea27fea2 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:20.064290 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4eca5fba-9839-46f9-8a8b-5d13338789a5 req-c7133bfc-7c60-40b0-9552-1d39ea27fea2 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 945 time: 0.1552210
May 31 16:23:20.065758 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:23:20.170677 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:23:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-14127f3d-c5ea-4a69-9401-3b3ca4196dd8 x-openstack-request-id: req-14127f3d-c5ea-4a69-9401-3b3ca4196dd8 {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:23:20.171221 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1d2436ad-b7ce-4d4c-851a-544a84fe2ef5", "tag": "747cd83a-69bc-48d9-8ba9-e9638b7be825", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:23:20.171331 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-14127f3d-c5ea-4a69-9401-3b3ca4196dd8 {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:23:20.171801 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1d2436ad-b7ce-4d4c-851a-544a84fe2ef5', 'tag': '747cd83a-69bc-48d9-8ba9-e9638b7be825', 'status': 'completed', 'code': 200}
May 31 16:23:20.192094 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:20.199269 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:20.206795 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-ec57ec0f-73e3-49eb-a1fe-c14955a76259 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:20.244476 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Pushing event updated for resources: {'SecurityGroup': ['ID=85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:20.256836 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:20.257466 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:20.258088 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:20.258659 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:20.259225 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:20.259810 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:20.259994 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4eca5fba-9839-46f9-8a8b-5d13338789a5 req-fe605197-c95d-4f16-8134-fbe7a75f0085 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1947446
May 31 16:23:20.260584 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:20.261193 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:20.261798 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:20.262359 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:20.262936 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:20.264002 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:20.292269 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:20.302609 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:20.307722 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.3902504
May 31 16:23:20.308990 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 33764) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:23:20.315277 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-8d9b608e-add3-4952-8972-b26ce50b19df tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Request body: {'security_group_rule': {'security_group_id': '85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78', 'project_id': '8e66b29e29094a429643e0308704753b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:23:20.323208 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-8d9b608e-add3-4952-8972-b26ce50b19df tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:23:20.327908 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-8d9b608e-add3-4952-8972-b26ce50b19df tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Usage tracker for resource:security_group_rule and tenant:8e66b29e29094a429643e0308704753b is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:23:20.333493 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-8d9b608e-add3-4952-8972-b26ce50b19df tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:23:20.340962 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-8d9b608e-add3-4952-8972-b26ce50b19df tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:23:20.341148 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-4755077c-2578-445f-a277-9bc160814c55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426b00040>, [{'id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'name': 'tempest-TestMinimumBasicScenario-134910460-router', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182'}], 'enable_snat': True}, 'gw_port_id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:27Z', 'updated_at': '2021-05-31T16:21:37Z', 'revision_number': 4, 'project_id': '8e66b29e29094a429643e0308704753b', 'gw_port': {'id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:07:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_gateway', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:29Z', 'updated_at': '2021-05-31T16:21:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': '0bdaa7f7-9a86-4bcf-a99d-ff3f1902bcc0', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'floating_ip_address': '172.27.0.194', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'port_id': '747cd83a-69bc-48d9-8ba9-e9638b7be825', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 443, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf', 'mac_address': 'fa:16:3e:54:a8:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d2436ad-b7ce-4d4c-851a-544a84fe2ef5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:23:17Z', 'updated_at': '2021-05-31T16:23:17Z', 'revision_number': 0, 'project_id': '8e66b29e29094a429643e0308704753b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ec5c850b-3c95-4ae6-869b-87be2055c0aa', 'name': '', 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'mac_address': 'fa:16:3e:cb:c9:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_interface', 'standard_attr_id': 328, 'fixed_ips': [{'subnet_id': '1a675b0f-478f-47e0-acdd-51bacffe39b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:36Z', 'updated_at': '2021-05-31T16:21:45Z', 'revision_number': 5, 'project_id': '8e66b29e29094a429643e0308704753b', 'subnets': [{'id': '1a675b0f-478f-47e0-acdd-51bacffe39b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:23:20.345251 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4755077c-2578-445f-a277-9bc160814c55 None None] Checking router: 7928d30e-0100-4eb5-9431-cf404997bd15 for host: dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:23:20.354046 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4755077c-2578-445f-a277-9bc160814c55 None None] Routers {'7928d30e-0100-4eb5-9431-cf404997bd15'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:23:20.354930 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-4755077c-2578-445f-a277-9bc160814c55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426b00040>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:23:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['7928d30e-0100-4eb5-9431-cf404997bd15'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:23:20.366566 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8d9b608e-add3-4952-8972-b26ce50b19df tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:20.415400 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33b09aad-d9e2-4dd5-98c2-82ab8cdf8630 req-526b9ced-8e34-4745-a09d-9ad47d911ac8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:20.419408 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-33b09aad-d9e2-4dd5-98c2-82ab8cdf8630 req-526b9ced-8e34-4745-a09d-9ad47d911ac8 service neutron] 10.222.0.63 "GET /v2.0/networks?id=be7d7603-734f-43bb-92a8-ed07a835aeb5 HTTP/1.1" status: 200  len: 917 time: 0.3967640
May 31 16:23:20.433399 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8d9b608e-add3-4952-8972-b26ce50b19df tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:20.439907 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8d9b608e-add3-4952-8972-b26ce50b19df tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:20.442246 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:20.475944 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d9b608e-add3-4952-8972-b26ce50b19df tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e6c5ffe6-f5a6-4d41-ab2a-315f9f650272,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:20.479604 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-8d9b608e-add3-4952-8972-b26ce50b19df tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:20.481850 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dacceb71-a008-4171-919f-7af7b3660689 req-6ef2e179-3fb0-41fc-a66a-09f16142f47d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:20.483324 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-dacceb71-a008-4171-919f-7af7b3660689 req-6ef2e179-3fb0-41fc-a66a-09f16142f47d service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=8e66b29e29094a429643e0308704753b&device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 1098 time: 0.3459747
May 31 16:23:20.486772 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8d9b608e-add3-4952-8972-b26ce50b19df tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:20.488639 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-8d9b608e-add3-4952-8972-b26ce50b19df tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1783392
May 31 16:23:20.491404 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 33770) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:23:20.538154 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-4755077c-2578-445f-a277-9bc160814c55 None None] Set router 7928d30e-0100-4eb5-9431-cf404997bd15 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:23:20.561173 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-b816631a-ea1c-4b95-bba5-93db444bd658 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Request body: {'security_group_rule': {'security_group_id': '85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78', 'project_id': '8e66b29e29094a429643e0308704753b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:23:20.601352 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-b816631a-ea1c-4b95-bba5-93db444bd658 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:23:20.667934 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-b816631a-ea1c-4b95-bba5-93db444bd658 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Usage tracker for resource:security_group_rule and tenant:8e66b29e29094a429643e0308704753b is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:23:20.683644 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-b816631a-ea1c-4b95-bba5-93db444bd658 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:23:20.713626 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-b816631a-ea1c-4b95-bba5-93db444bd658 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:23:20.746473 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aac3257-743e-47df-b490-6ee0cde0d8a9 req-927d0e51-3622-4b40-b110-8baf3705be5a tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:20.747854 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4aac3257-743e-47df-b490-6ee0cde0d8a9 req-927d0e51-3622-4b40-b110-8baf3705be5a tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=15f6dcaf-fed7-4ab4-88fc-68d4a0db9938 HTTP/1.1" status: 200  len: 945 time: 0.4706433
May 31 16:23:20.776710 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-33b09aad-d9e2-4dd5-98c2-82ab8cdf8630 req-24a43a95-0741-4d68-abd0-e88bfe5263f2 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=8cf870c7-bdf1-490f-adfa-61e27997bc91 HTTP/1.1" status: 200  len: 1000 time: 0.2923939
May 31 16:23:20.795026 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b816631a-ea1c-4b95-bba5-93db444bd658 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:20.879380 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dacceb71-a008-4171-919f-7af7b3660689 req-f331ecf7-ca77-4f68-a799-2d9dc38b3ee4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:20.880811 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-dacceb71-a008-4171-919f-7af7b3660689 req-f331ecf7-ca77-4f68-a799-2d9dc38b3ee4 service neutron] 10.222.0.63 "GET /v2.0/networks?id=e3df5118-0a40-4a66-b31c-a978a0c899cf HTTP/1.1" status: 200  len: 915 time: 0.3235123
May 31 16:23:20.890304 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-4755077c-2578-445f-a277-9bc160814c55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426b00040>, [{'id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'name': 'tempest-TestMinimumBasicScenario-134910460-router', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182'}], 'enable_snat': True}, 'gw_port_id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:27Z', 'updated_at': '2021-05-31T16:21:37Z', 'revision_number': 4, 'project_id': '8e66b29e29094a429643e0308704753b', 'gw_port': {'id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:07:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_gateway', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:29Z', 'updated_at': '2021-05-31T16:21:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': '0bdaa7f7-9a86-4bcf-a99d-ff3f1902bcc0', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'floating_ip_address': '172.27.0.194', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'port_id': '747cd83a-69bc-48d9-8ba9-e9638b7be825', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 443, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf', 'mac_address': 'fa:16:3e:54:a8:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d2436ad-b7ce-4d4c-851a-544a84fe2ef5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:23:17Z', 'updated_at': '2021-05-31T16:23:17Z', 'revision_number': 0, 'project_id': '8e66b29e29094a429643e0308704753b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ec5c850b-3c95-4ae6-869b-87be2055c0aa', 'name': '', 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'mac_address': 'fa:16:3e:cb:c9:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_interface', 'standard_attr_id': 328, 'fixed_ips': [{'subnet_id': '1a675b0f-478f-47e0-acdd-51bacffe39b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:36Z', 'updated_at': '2021-05-31T16:21:45Z', 'revision_number': 5, 'project_id': '8e66b29e29094a429643e0308704753b', 'subnets': [{'id': '1a675b0f-478f-47e0-acdd-51bacffe39b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:23:20.895081 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4755077c-2578-445f-a277-9bc160814c55 None None] The sync data for ids ['7928d30e-0100-4eb5-9431-cf404997bd15'] in dv-cinder-793814-1-iscsi is: [{'id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'name': 'tempest-TestMinimumBasicScenario-134910460-router', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182'}], 'enable_snat': True}, 'gw_port_id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:27Z', 'updated_at': '2021-05-31T16:21:37Z', 'revision_number': 4, 'project_id': '8e66b29e29094a429643e0308704753b', 'gw_port': {'id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:07:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_gateway', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:29Z', 'updated_at': '2021-05-31T16:21:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': '0bdaa7f7-9a86-4bcf-a99d-ff3f1902bcc0', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'floating_ip_address': '172.27.0.194', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'port_id': '747cd83a-69bc-48d9-8ba9-e9638b7be825', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 443, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf', 'mac_address': 'fa:16:3e:54:a8:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d2436ad-b7ce-4d4c-851a-544a84fe2ef5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:23:17Z', 'updated_at': '2021-05-31T16:23:17Z', 'revision_number': 0, 'project_id': '8e66b29e29094a429643e0308704753b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ec5c850b-3c95-4ae6-869b-87be2055c0aa', 'name': '', 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'mac_address': 'fa:16:3e:cb:c9:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_interface', 'standard_attr_id': 328, 'fixed_ips': [{'subnet_id': '1a675b0f-478f-47e0-acdd-51bacffe39b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:36Z', 'updated_at': '2021-05-31T16:21:45Z', 'revision_number': 5, 'project_id': '8e66b29e29094a429643e0308704753b', 'subnets': [{'id': '1a675b0f-478f-47e0-acdd-51bacffe39b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:23:20.915960 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-199f736b-adbc-44ba-9d19-1717c949e7e3 req-10ca1300-5b7c-4e8a-82be-ba9ea0aa9b92 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:20.917404 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-199f736b-adbc-44ba-9d19-1717c949e7e3 req-10ca1300-5b7c-4e8a-82be-ba9ea0aa9b92 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.4945974
May 31 16:23:21.095125 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9009f259-5c49-4293-b93e-cb312b17b8de None None] New status for floating IP 0bdaa7f7-9a86-4bcf-a99d-ff3f1902bcc0: ACTIVE {{(pid=91765) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 31 16:23:21.168795 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4aac3257-743e-47df-b490-6ee0cde0d8a9 req-ebdb2acf-23a8-4366-a67f-e1f4c35c40be tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3977737
May 31 16:23:21.176087 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33b09aad-d9e2-4dd5-98c2-82ab8cdf8630 req-4ef1fc7f-6583-44e0-a7d5-8db2aa250f93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:21.177726 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-33b09aad-d9e2-4dd5-98c2-82ab8cdf8630 req-4ef1fc7f-6583-44e0-a7d5-8db2aa250f93 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=eb5363fe-ee39-4adc-b299-6098caad681d HTTP/1.1" status: 200  len: 855 time: 0.3605952
May 31 16:23:21.219233 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-dacceb71-a008-4171-919f-7af7b3660689 req-aed1a4c3-6a57-4a44-840e-88a8a239f18f service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=747cd83a-69bc-48d9-8ba9-e9638b7be825 HTTP/1.1" status: 200  len: 999 time: 0.3119223
May 31 16:23:21.222853 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b816631a-ea1c-4b95-bba5-93db444bd658 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:21.262855 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-199f736b-adbc-44ba-9d19-1717c949e7e3 req-e288d82f-eda4-4aa7-8c2b-a402821b844a tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2782071
May 31 16:23:21.297411 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b816631a-ea1c-4b95-bba5-93db444bd658 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:21.358159 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:21.406255 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b816631a-ea1c-4b95-bba5-93db444bd658 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bad9c9b9-dc13-46f3-8fe0-f5f8fdc76eb5,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:21.461211 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-b816631a-ea1c-4b95-bba5-93db444bd658 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:21.478448 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dacceb71-a008-4171-919f-7af7b3660689 req-8117dd51-601c-4d8e-aeb6-143785f08774 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:21.479946 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-dacceb71-a008-4171-919f-7af7b3660689 req-8117dd51-601c-4d8e-aeb6-143785f08774 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=1a675b0f-478f-47e0-acdd-51bacffe39b6 HTTP/1.1" status: 200  len: 853 time: 0.2250352
May 31 16:23:21.491994 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b816631a-ea1c-4b95-bba5-93db444bd658 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:21.504847 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-b816631a-ea1c-4b95-bba5-93db444bd658 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.9493399
May 31 16:23:21.509021 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 33816) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:23:21.520039 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-122fe52c-e2c8-410d-8c65-9170864e2071 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Request body: {'security_group_rule': {'security_group_id': '85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78', 'project_id': '8e66b29e29094a429643e0308704753b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:23:21.530716 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-122fe52c-e2c8-410d-8c65-9170864e2071 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:23:21.535342 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-122fe52c-e2c8-410d-8c65-9170864e2071 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Usage tracker for resource:security_group_rule and tenant:8e66b29e29094a429643e0308704753b is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:23:21.539682 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-122fe52c-e2c8-410d-8c65-9170864e2071 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:23:21.547686 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-122fe52c-e2c8-410d-8c65-9170864e2071 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:23:21.579217 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-122fe52c-e2c8-410d-8c65-9170864e2071 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:21.580337 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33b09aad-d9e2-4dd5-98c2-82ab8cdf8630 req-a153dc15-3b15-4b41-a60f-a2a97a54158e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:21.582276 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-33b09aad-d9e2-4dd5-98c2-82ab8cdf8630 req-a153dc15-3b15-4b41-a60f-a2a97a54158e service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=be7d7603-734f-43bb-92a8-ed07a835aeb5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3679917
May 31 16:23:21.634635 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6da40ffc-f733-4e2e-9e7c-0266e9a09e16 req-851b9ebd-25b0-42b5-897e-82071b5c5d99 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:21.642606 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6da40ffc-f733-4e2e-9e7c-0266e9a09e16 req-851b9ebd-25b0-42b5-897e-82071b5c5d99 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.3395150
May 31 16:23:21.666762 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-122fe52c-e2c8-410d-8c65-9170864e2071 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:21.671544 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-122fe52c-e2c8-410d-8c65-9170864e2071 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:21.681258 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d4ffb810-acbe-4810-8b00-949049912504 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:21.706939 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-122fe52c-e2c8-410d-8c65-9170864e2071 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e03d9c4f-ba9f-45af-8816-0706df3ca7ec,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:21.709910 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-122fe52c-e2c8-410d-8c65-9170864e2071 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:21.715748 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-122fe52c-e2c8-410d-8c65-9170864e2071 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:21.717184 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-122fe52c-e2c8-410d-8c65-9170864e2071 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.2069790
May 31 16:23:21.721264 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 33820) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:23:21.729646 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-a913f77d-f36d-4e0e-a8ad-6a052aec6408 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Request body: {'security_group_rule': {'security_group_id': '85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78', 'project_id': '8e66b29e29094a429643e0308704753b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:23:21.736464 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-a913f77d-f36d-4e0e-a8ad-6a052aec6408 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:23:21.741153 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-a913f77d-f36d-4e0e-a8ad-6a052aec6408 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Usage tracker for resource:security_group_rule and tenant:8e66b29e29094a429643e0308704753b is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:23:21.744720 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-a913f77d-f36d-4e0e-a8ad-6a052aec6408 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:23:21.753710 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-a913f77d-f36d-4e0e-a8ad-6a052aec6408 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:23:21.764011 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7ace064-2253-41da-bda7-669620039f76 req-8b486776-bd59-4df8-91ea-9ef6e8de061b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:21.765612 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d7ace064-2253-41da-bda7-669620039f76 req-8b486776-bd59-4df8-91ea-9ef6e8de061b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 945 time: 0.3747065
May 31 16:23:21.775949 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-a913f77d-f36d-4e0e-a8ad-6a052aec6408 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:21.803723 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6da40ffc-f733-4e2e-9e7c-0266e9a09e16 req-21cde806-0ace-4a37-b924-65d3c70af3d6 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1602101
May 31 16:23:21.840694 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dacceb71-a008-4171-919f-7af7b3660689 req-d5151ee3-458d-45ee-97d8-703dab19b9e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:21.842601 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-dacceb71-a008-4171-919f-7af7b3660689 req-d5151ee3-458d-45ee-97d8-703dab19b9e0 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=e3df5118-0a40-4a66-b31c-a978a0c899cf&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3453116
May 31 16:23:21.860029 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-a913f77d-f36d-4e0e-a8ad-6a052aec6408 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:21.866311 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-a913f77d-f36d-4e0e-a8ad-6a052aec6408 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:21.872601 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:21.897459 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a913f77d-f36d-4e0e-a8ad-6a052aec6408 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=04c35795-d19a-4dcf-a288-c707a44d8b42,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:21.900423 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-a913f77d-f36d-4e0e-a8ad-6a052aec6408 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:21.905766 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-33b09aad-d9e2-4dd5-98c2-82ab8cdf8630 req-bb98e7a0-5ddc-4d05-8e88-7b228dd8ac4e service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3104045
May 31 16:23:21.911792 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-a913f77d-f36d-4e0e-a8ad-6a052aec6408 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:21.913574 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-a913f77d-f36d-4e0e-a8ad-6a052aec6408 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.1911023
May 31 16:23:21.916288 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 33824) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:23:21.921616 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-67c8def1-706d-45ba-a71d-cc56fe2cf74c tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Request body: {'security_group_rule': {'security_group_id': '85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78', 'project_id': '8e66b29e29094a429643e0308704753b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:23:21.927120 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d7ace064-2253-41da-bda7-669620039f76 req-31039197-556b-45bb-87c9-c2cececfefc0 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1425586
May 31 16:23:21.928403 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-67c8def1-706d-45ba-a71d-cc56fe2cf74c tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:23:21.932883 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-67c8def1-706d-45ba-a71d-cc56fe2cf74c tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Usage tracker for resource:security_group_rule and tenant:8e66b29e29094a429643e0308704753b is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:23:21.935802 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-67c8def1-706d-45ba-a71d-cc56fe2cf74c tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:23:21.943671 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-67c8def1-706d-45ba-a71d-cc56fe2cf74c tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:23:21.955579 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.securitygroups_db [None req-67c8def1-706d-45ba-a71d-cc56fe2cf74c tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Project 8e66b29e29094a429643e0308704753b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 31 16:23:21.961878 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-67c8def1-706d-45ba-a71d-cc56fe2cf74c tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:22.045465 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-67c8def1-706d-45ba-a71d-cc56fe2cf74c tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:22.051124 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-67c8def1-706d-45ba-a71d-cc56fe2cf74c tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:22.064883 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-de9fa733-c5c1-45da-87a9-46c2a61b084c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:22.086045 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67c8def1-706d-45ba-a71d-cc56fe2cf74c tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6126ef62-267b-436b-8c92-6aaf3600d0d8,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:22.090124 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-67c8def1-706d-45ba-a71d-cc56fe2cf74c tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:22.106955 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-67c8def1-706d-45ba-a71d-cc56fe2cf74c tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:22.113789 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-67c8def1-706d-45ba-a71d-cc56fe2cf74c tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.1964056
May 31 16:23:22.116382 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 33832) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:23:22.124002 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-9295a756-708c-4712-b582-1a619e2c92d5 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Request body: {'security_group_rule': {'security_group_id': '85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78', 'project_id': '8e66b29e29094a429643e0308704753b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:23:22.131636 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-9295a756-708c-4712-b582-1a619e2c92d5 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:23:22.135950 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-9295a756-708c-4712-b582-1a619e2c92d5 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Usage tracker for resource:security_group_rule and tenant:8e66b29e29094a429643e0308704753b is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:23:22.139128 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-9295a756-708c-4712-b582-1a619e2c92d5 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:23:22.155021 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-9295a756-708c-4712-b582-1a619e2c92d5 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:23:22.165916 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.securitygroups_db [None req-9295a756-708c-4712-b582-1a619e2c92d5 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Project 8e66b29e29094a429643e0308704753b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 31 16:23:22.171930 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9295a756-708c-4712-b582-1a619e2c92d5 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:22.179562 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-33b09aad-d9e2-4dd5-98c2-82ab8cdf8630 req-6e41526c-728a-4c30-8fdb-b379fe61c5b0 service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2514219
May 31 16:23:22.187284 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-dacceb71-a008-4171-919f-7af7b3660689 req-9a2c3902-b899-4d39-b18d-879a32c6306c service neutron] 10.222.0.63 "GET /v2.0/networks/e3df5118-0a40-4a66-b31c-a978a0c899cf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3206804
May 31 16:23:22.241430 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9295a756-708c-4712-b582-1a619e2c92d5 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:22.247557 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9295a756-708c-4712-b582-1a619e2c92d5 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:22.250044 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-214e2809-29b3-42b9-a354-b00884072aca tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:22.273919 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9295a756-708c-4712-b582-1a619e2c92d5 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=09a5cfa1-a530-4292-addf-a5522c5194ae,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:22.277543 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-9295a756-708c-4712-b582-1a619e2c92d5 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:22.288396 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9295a756-708c-4712-b582-1a619e2c92d5 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:22.292844 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-9295a756-708c-4712-b582-1a619e2c92d5 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.1728601
May 31 16:23:22.341205 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-dacceb71-a008-4171-919f-7af7b3660689 req-f7817e4c-5164-4311-bfa3-2bc3c088442f service neutron] 10.222.0.63 "GET /v2.0/networks/e3df5118-0a40-4a66-b31c-a978a0c899cf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1403651
May 31 16:23:22.498014 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7cd78dbc-eb18-4a18-ac00-f53b2a59f01c req-903435b8-56bb-4a0f-81fd-88b8c41a6916 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1685154645&fields=id&tenant_id=8e66b29e29094a429643e0308704753b HTTP/1.1" status: 200  len: 267 time: 0.0964024
May 31 16:23:22.562469 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a8a0598-e163-468f-a986-4a86c2359f59 req-09ff3555-9c23-4f82-b04e-4ac863fa8153 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:22.564495 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2a8a0598-e163-468f-a986-4a86c2359f59 req-09ff3555-9c23-4f82-b04e-4ac863fa8153 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.1647882
May 31 16:23:22.632263 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2a8a0598-e163-468f-a986-4a86c2359f59 req-db3b3823-3b4c-49b5-85bd-45d8a60387fe tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0587447
May 31 16:23:22.640451 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cd78dbc-eb18-4a18-ac00-f53b2a59f01c req-380b8289-d8e0-405d-9cc6-3b0ec9c09369 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:22.642484 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7cd78dbc-eb18-4a18-ac00-f53b2a59f01c req-380b8289-d8e0-405d-9cc6-3b0ec9c09369 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 945 time: 0.1378350
May 31 16:23:22.655992 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-7cd78dbc-eb18-4a18-ac00-f53b2a59f01c req-cf8f1614-ad2e-4d95-98a3-c1b294d7ead3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Request body: {'port': {'security_groups': ['36428dc9-0862-4d53-8a33-6b298f5353c7', '85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78']}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:23:22.803226 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-7cd78dbc-eb18-4a18-ac00-f53b2a59f01c req-cf8f1614-ad2e-4d95-98a3-c1b294d7ead3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:23.328436 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-7cd78dbc-eb18-4a18-ac00-f53b2a59f01c req-cf8f1614-ad2e-4d95-98a3-c1b294d7ead3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] For port 747cd83a-69bc-48d9-8ba9-e9638b7be825, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=747cd83a-69bc-48d9-8ba9-e9638b7be825,segment=NetworkSegment(44700c9f-b523-4212-86eb-cc7308ee0431),segment_id=44700c9f-b523-4212-86eb-cc7308ee0431)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:23:23.356688 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35e6be2a-4d01-4f89-acf4-c07dcc5fded1 req-42dc2504-a93b-49fb-a4d4-d5742e9b7a80 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:23.360814 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-35e6be2a-4d01-4f89-acf4-c07dcc5fded1 req-42dc2504-a93b-49fb-a4d4-d5742e9b7a80 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.2725501
May 31 16:23:23.387576 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-7cd78dbc-eb18-4a18-ac00-f53b2a59f01c req-cf8f1614-ad2e-4d95-98a3-c1b294d7ead3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for port, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:23.394871 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-7cd78dbc-eb18-4a18-ac00-f53b2a59f01c req-cf8f1614-ad2e-4d95-98a3-c1b294d7ead3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:23.401934 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:23.407666 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['747cd83a-69bc-48d9-8ba9-e9638b7be825'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:23:23.485131 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-35e6be2a-4d01-4f89-acf4-c07dcc5fded1 req-e7c3f17c-f200-4c3d-9b83-ffd0ced65059 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1174030
May 31 16:23:23.493880 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cd78dbc-eb18-4a18-ac00-f53b2a59f01c req-cf8f1614-ad2e-4d95-98a3-c1b294d7ead3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:23.494618 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-7cd78dbc-eb18-4a18-ac00-f53b2a59f01c req-cf8f1614-ad2e-4d95-98a3-c1b294d7ead3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:23.496079 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7cd78dbc-eb18-4a18-ac00-f53b2a59f01c req-cf8f1614-ad2e-4d95-98a3-c1b294d7ead3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "PUT /v2.0/ports/747cd83a-69bc-48d9-8ba9-e9638b7be825 HTTP/1.1" status: 200  len: 981 time: 0.8464015
May 31 16:23:23.496669 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1d2436ad-b7ce-4d4c-851a-544a84fe2ef5', 'tag': '747cd83a-69bc-48d9-8ba9-e9638b7be825'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:23:23.499434 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ccdb381a-16a6-4fa5-8e7b-d0b98af9ffaa" -d '{"events": [{"name": "network-changed", "server_uuid": "1d2436ad-b7ce-4d4c-851a-544a84fe2ef5", "tag": "747cd83a-69bc-48d9-8ba9-e9638b7be825"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:23:23.527407 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf8f1614-ad2e-4d95-98a3-c1b294d7ead3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Pushing event updated for resources: {'Port': ['ID=747cd83a-69bc-48d9-8ba9-e9638b7be825,revision_number=6']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:23.531205 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-cf8f1614-ad2e-4d95-98a3-c1b294d7ead3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:23.682530 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['747cd83a-69bc-48d9-8ba9-e9638b7be825'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:23:23.819886 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab86cda7-a2fb-4141-8504-3005581c4000 req-d64e4f26-461f-4cd1-8585-78501a95c8fd tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:23.821426 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ab86cda7-a2fb-4141-8504-3005581c4000 req-d64e4f26-461f-4cd1-8585-78501a95c8fd tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 945 time: 0.2100306
May 31 16:23:23.837591 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2af24d45-2bde-4560-ac7e-681797678517 req-2baf9571-f47d-4d38-8b6b-799b8cd084cb tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:23.839096 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2af24d45-2bde-4560-ac7e-681797678517 req-2baf9571-f47d-4d38-8b6b-799b8cd084cb tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 984 time: 0.1580226
May 31 16:23:23.923920 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ab86cda7-a2fb-4141-8504-3005581c4000 req-4a1c9b9a-cdc1-42e0-880b-0b7b466dc2fc tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0946631
May 31 16:23:23.941967 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2af24d45-2bde-4560-ac7e-681797678517 req-297e038b-091a-4362-864b-f90fd044d4c3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78&id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0880027
May 31 16:23:23.968718 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-ac214ede-954b-4b9a-9d8b-5e3146a7648c None None] Provisioning complete for port 747cd83a-69bc-48d9-8ba9-e9638b7be825 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:23:23.969142 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-ac214ede-954b-4b9a-9d8b-5e3146a7648c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:24.010335 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:23:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7527fe57-f4e4-413a-bbc8-0d83d55ab8cb x-openstack-request-id: req-7527fe57-f4e4-413a-bbc8-0d83d55ab8cb {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:23:24.010335 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1d2436ad-b7ce-4d4c-851a-544a84fe2ef5", "tag": "747cd83a-69bc-48d9-8ba9-e9638b7be825", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:23:24.010335 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-7527fe57-f4e4-413a-bbc8-0d83d55ab8cb {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:23:24.010864 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1d2436ad-b7ce-4d4c-851a-544a84fe2ef5', 'tag': '747cd83a-69bc-48d9-8ba9-e9638b7be825', 'status': 'completed', 'code': 200}
May 31 16:23:24.171976 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd3762dd-926c-4b53-a274-e071a0308373 req-ff3f7454-cbe8-4e4a-8076-7e0718d4e4c7 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:24.176714 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-dd3762dd-926c-4b53-a274-e071a0308373 req-ff3f7454-cbe8-4e4a-8076-7e0718d4e4c7 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.0983779
May 31 16:23:24.223234 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-dd3762dd-926c-4b53-a274-e071a0308373 req-ceea8f8d-d2d4-4794-b230-f8db76f69f0e tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0418653
May 31 16:23:24.717405 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7b74a35-a10c-4cf1-ace2-f6733d15c025 req-3848f292-3256-412e-b32a-2b5ec80f9705 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:24.718811 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a7b74a35-a10c-4cf1-ace2-f6733d15c025 req-3848f292-3256-412e-b32a-2b5ec80f9705 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.0885623
May 31 16:23:24.768433 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a7b74a35-a10c-4cf1-ace2-f6733d15c025 req-7e3334ca-cf1b-492e-9fca-27c32b1fb5d5 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0433667
May 31 16:23:25.127203 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c0cd78d-3a65-47e1-b2e1-8c6b6c8e3a76 req-b2da3e63-b74c-4678-b1e2-3a837b2e3e38 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:25.133696 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8c0cd78d-3a65-47e1-b2e1-8c6b6c8e3a76 req-b2da3e63-b74c-4678-b1e2-3a837b2e3e38 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 945 time: 0.0894532
May 31 16:23:25.177272 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8c0cd78d-3a65-47e1-b2e1-8c6b6c8e3a76 req-05c5e8c3-c2f2-44dd-85aa-2b4fbde2af55 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0407591
May 31 16:23:25.425755 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2d23974-cd62-4b9c-b263-342eeb5e87a8 req-ef2ebc84-b2b9-4a34-8d95-02f6f48083f2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:25.427353 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f2d23974-cd62-4b9c-b263-342eeb5e87a8 req-ef2ebc84-b2b9-4a34-8d95-02f6f48083f2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.0948386
May 31 16:23:25.475524 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f2d23974-cd62-4b9c-b263-342eeb5e87a8 req-dfc01544-21c0-4dd2-8369-b2300a8e776a tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0418944
May 31 16:23:25.970219 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50dd61af-500e-4241-8fd4-16c18fb984dc req-3ba1b6d1-e556-43d2-b37b-63c92296553d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:25.972144 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-50dd61af-500e-4241-8fd4-16c18fb984dc req-3ba1b6d1-e556-43d2-b37b-63c92296553d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.0881984
May 31 16:23:26.024521 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-50dd61af-500e-4241-8fd4-16c18fb984dc req-4d2f12c4-914a-4ebd-a170-014b75ccb6ac tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0465157
May 31 16:23:26.373508 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-041e17d0-b06a-43c6-bd3c-99b93af1cd86 req-cfc4783e-1d3d-431b-a7c5-e9bbe3f08b36 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:26.375171 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-041e17d0-b06a-43c6-bd3c-99b93af1cd86 req-cfc4783e-1d3d-431b-a7c5-e9bbe3f08b36 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 945 time: 0.0839939
May 31 16:23:26.424822 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-041e17d0-b06a-43c6-bd3c-99b93af1cd86 req-18abf984-d80f-41b1-89c2-ace46c698b14 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0434511
May 31 16:23:26.691594 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-429fc7cd-45e8-4ba1-8f17-f29e304b49bd req-f4bc3cc5-1006-4f2f-adb7-8dd3f4ed8a4a tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:26.693072 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-429fc7cd-45e8-4ba1-8f17-f29e304b49bd req-f4bc3cc5-1006-4f2f-adb7-8dd3f4ed8a4a tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.1017172
May 31 16:23:26.743159 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-429fc7cd-45e8-4ba1-8f17-f29e304b49bd req-99096fbe-d3ff-4c35-9f53-840e70a7afcb tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438364
May 31 16:23:27.228283 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9222776b-8ca4-4cda-a381-a9d9c2c611eb req-2569fd68-6636-4e6b-81f8-0960cf2dc930 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:27.229811 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9222776b-8ca4-4cda-a381-a9d9c2c611eb req-2569fd68-6636-4e6b-81f8-0960cf2dc930 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.0897460
May 31 16:23:27.277169 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9222776b-8ca4-4cda-a381-a9d9c2c611eb req-7b755c63-5dce-4163-903e-a1580f8de54a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0413074
May 31 16:23:27.620080 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e60eb457-52c2-438d-aa1c-53b58bf8a6dc req-34646308-5b14-4af6-a0be-30427c4363fd tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:27.621893 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e60eb457-52c2-438d-aa1c-53b58bf8a6dc req-34646308-5b14-4af6-a0be-30427c4363fd tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 945 time: 0.0859673
May 31 16:23:27.684000 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e60eb457-52c2-438d-aa1c-53b58bf8a6dc req-e4e8e0ae-4c9c-4a34-84c6-1b8ff34b9d69 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0542729
May 31 16:23:27.937066 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a1fc238-4ca0-401c-b474-f1615f0cb951 req-8f164ff9-6fa7-4980-bc8f-b08ccc715eae tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:27.939210 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7a1fc238-4ca0-401c-b474-f1615f0cb951 req-8f164ff9-6fa7-4980-bc8f-b08ccc715eae tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.0876901
May 31 16:23:27.991620 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7a1fc238-4ca0-401c-b474-f1615f0cb951 req-d7e3c139-8f9c-46cd-99a2-93cb31292ced tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0466392
May 31 16:23:28.473619 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8463304e-8c22-485d-9f02-b316f3b9772b req-3c794af6-7bd7-4fa6-80c7-4336371ef62d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:28.475208 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8463304e-8c22-485d-9f02-b316f3b9772b req-3c794af6-7bd7-4fa6-80c7-4336371ef62d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.0812230
May 31 16:23:28.520364 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device ed28e094-e3fd-4150-b73d-a9ce8dff7be4 no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:23:28.525472 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8463304e-8c22-485d-9f02-b316f3b9772b req-8074dde3-53a9-48a0-a8de-a3c2db63648a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0439887
May 31 16:23:28.631588 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:28.664837 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '69990510-6c38-4988-a0ec-18ae79233830', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'ed28e094-e3fd-4150-b73d-a9ce8dff7be4'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:23:28.667738 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6e5065b1-bb64-453d-9283-ed421f8e25b6" -d '{"events": [{"server_uuid": "69990510-6c38-4988-a0ec-18ae79233830", "name": "network-vif-unplugged", "status": "completed", "tag": "ed28e094-e3fd-4150-b73d-a9ce8dff7be4"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:23:28.677037 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port ed28e094-e3fd-4150-b73d-a9ce8dff7be4, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=ed28e094-e3fd-4150-b73d-a9ce8dff7be4,segment=NetworkSegment(016e9daa-b906-4ec8-978d-cb58fbcd78da),segment_id=016e9daa-b906-4ec8-978d-cb58fbcd78da)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:23:28.682649 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:28.684454 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:28.739497 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Mon, 31 May 2021 16:23:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8ce9472a-fb6c-4d51-ad00-01c11ab7f530 x-openstack-request-id: req-8ce9472a-fb6c-4d51-ad00-01c11ab7f530 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:23:28.739786 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "69990510-6c38-4988-a0ec-18ae79233830", "name": "network-vif-unplugged", "status": "completed", "tag": "ed28e094-e3fd-4150-b73d-a9ce8dff7be4", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:23:28.740046 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-8ce9472a-fb6c-4d51-ad00-01c11ab7f530 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:23:28.740432 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '69990510-6c38-4988-a0ec-18ae79233830', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'ed28e094-e3fd-4150-b73d-a9ce8dff7be4', 'code': 200}
May 31 16:23:28.755887 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=ed28e094-e3fd-4150-b73d-a9ce8dff7be4,revision_number=6']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:28.764082 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:28.764082 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:28.764340 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:28.764536 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:28.764780 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:28.765102 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:28.765409 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:28.765776 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:28.766265 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:28.767149 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:28.767701 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:28.768179 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:23:28.772171 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:28.911173 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2775f6f-99e2-49c3-9d3e-5b6e806f2719 req-b7b523c4-eb37-4a48-ba4c-7d83592404f3 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:28.912667 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a2775f6f-99e2-49c3-9d3e-5b6e806f2719 req-b7b523c4-eb37-4a48-ba4c-7d83592404f3 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.1018107
May 31 16:23:28.962484 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a2775f6f-99e2-49c3-9d3e-5b6e806f2719 req-1365a59b-d101-42cc-a62f-ac85c0b2c94b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0434268
May 31 16:23:29.206952 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f78eaac1-2ff3-44d1-ac1a-09ca9f451449 req-e8d78150-748b-43a9-8a2e-b1e954f2b1dd tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:29.208497 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f78eaac1-2ff3-44d1-ac1a-09ca9f451449 req-e8d78150-748b-43a9-8a2e-b1e954f2b1dd tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.0983787
May 31 16:23:29.256652 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f78eaac1-2ff3-44d1-ac1a-09ca9f451449 req-233fe8a1-2f82-4957-a9aa-9a3ddd8bb6ec tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421581
May 31 16:23:29.735953 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ef83a2b-5397-4fa0-9ac4-490c6cd85501 req-d49a3920-c3d2-4155-a242-d4e847772c74 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:29.737385 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1ef83a2b-5397-4fa0-9ac4-490c6cd85501 req-d49a3920-c3d2-4155-a242-d4e847772c74 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.0946133
May 31 16:23:29.786528 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1ef83a2b-5397-4fa0-9ac4-490c6cd85501 req-f1ec1300-a20e-4a06-ad34-af6f13f48911 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0433772
May 31 16:23:30.160289 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-441a54c2-59f7-450e-afaa-cd34e7419e4d req-65c6d169-2e44-415a-8165-ddc38e61865a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:30.161769 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-441a54c2-59f7-450e-afaa-cd34e7419e4d req-65c6d169-2e44-415a-8165-ddc38e61865a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.0840306
May 31 16:23:30.213082 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-441a54c2-59f7-450e-afaa-cd34e7419e4d req-7812b281-76c4-454e-920f-3b54053490f3 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0454988
May 31 16:23:30.455715 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d2ccb4d-1f22-475b-bccc-8b6511b606d8 req-2aaa40fb-a380-4438-967c-7204ff44da9e tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:30.457384 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1d2ccb4d-1f22-475b-bccc-8b6511b606d8 req-2aaa40fb-a380-4438-967c-7204ff44da9e tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.0876136
May 31 16:23:30.506099 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1d2ccb4d-1f22-475b-bccc-8b6511b606d8 req-4c92e12b-05b7-46c0-abcb-e851afb68d83 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0423799
May 31 16:23:31.011197 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1fe158f-59fa-4a67-bdb6-36481b45db34 req-7e3ad417-6f17-4f8b-9003-88c3c83588e7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:31.012742 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b1fe158f-59fa-4a67-bdb6-36481b45db34 req-7e3ad417-6f17-4f8b-9003-88c3c83588e7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.1004248
May 31 16:23:31.154426 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b1fe158f-59fa-4a67-bdb6-36481b45db34 req-5b0fc9b9-0939-417a-8477-20e213e2f1e4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1317692
May 31 16:23:31.412786 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d858920-73fa-40f5-9898-48c1b6092237 req-8fac8c86-71cc-4be9-bc36-a72f79071092 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:31.414248 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7d858920-73fa-40f5-9898-48c1b6092237 req-8fac8c86-71cc-4be9-bc36-a72f79071092 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.0816178
May 31 16:23:31.463979 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7d858920-73fa-40f5-9898-48c1b6092237 req-ecf73fb9-d864-4c92-b975-ce8b4aaab649 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436947
May 31 16:23:31.713317 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c3c4fc6-3245-4330-af02-02acd68643b4 req-9ab7c97f-4723-47e7-8b42-a02584287edf tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:31.714813 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1c3c4fc6-3245-4330-af02-02acd68643b4 req-9ab7c97f-4723-47e7-8b42-a02584287edf tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.0983124
May 31 16:23:31.771448 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1c3c4fc6-3245-4330-af02-02acd68643b4 req-2a33c769-deb2-46d3-a395-a9a761576591 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0435436
May 31 16:23:32.375016 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57c9fc12-60a8-499e-af2a-790691fe118c req-c18b6cd5-5b43-4ea3-aebd-54eb57ee00fb tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:32.376670 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-57c9fc12-60a8-499e-af2a-790691fe118c req-c18b6cd5-5b43-4ea3-aebd-54eb57ee00fb tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.0988448
May 31 16:23:32.427577 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-57c9fc12-60a8-499e-af2a-790691fe118c req-3b576a2d-5d11-48fb-86a1-0ff3edc17ef1 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0429397
May 31 16:23:32.665933 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12870a55-0398-41d5-a424-cba6e72e4ef7 req-08828814-ca14-4287-b90c-778fadb1fb41 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:32.667416 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-12870a55-0398-41d5-a424-cba6e72e4ef7 req-08828814-ca14-4287-b90c-778fadb1fb41 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.0934825
May 31 16:23:32.724335 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-12870a55-0398-41d5-a424-cba6e72e4ef7 req-86e8681e-c464-4a4a-819b-1543c5aa09c6 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0512090
May 31 16:23:32.968050 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4085eb0a-456f-4cd5-b493-99616795d943 req-6bdf47fb-92e4-4eca-9775-992b4b177599 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:32.970246 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4085eb0a-456f-4cd5-b493-99616795d943 req-6bdf47fb-92e4-4eca-9775-992b4b177599 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.0848298
May 31 16:23:33.042710 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4085eb0a-456f-4cd5-b493-99616795d943 req-b81c97d7-2cd4-48a6-9b3e-e26e9a500db2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0639296
May 31 16:23:33.625257 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-926085c1-97aa-4cd5-a66a-41c6ba27cd9f req-b6955666-b595-4c46-a67a-00543edcdc6e tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:33.627558 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-926085c1-97aa-4cd5-a66a-41c6ba27cd9f req-b6955666-b595-4c46-a67a-00543edcdc6e tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.0864813
May 31 16:23:33.673865 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-926085c1-97aa-4cd5-a66a-41c6ba27cd9f req-638ad003-3a7d-494a-9554-ad8323a3745a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0403717
May 31 16:23:33.936591 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30fb2826-fbd1-4a3b-bbe5-af1c57082683 req-65419e7a-45f4-4c64-8e19-5d2f6f2ba1c6 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:33.937998 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-30fb2826-fbd1-4a3b-bbe5-af1c57082683 req-65419e7a-45f4-4c64-8e19-5d2f6f2ba1c6 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.0919659
May 31 16:23:33.991198 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-30fb2826-fbd1-4a3b-bbe5-af1c57082683 req-4bef797f-9fee-4b4e-a76a-9a1c92f8c53c tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0471151
May 31 16:23:34.250118 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ad2446-ad96-41b3-93c5-657455a388ae req-84341ad0-4958-4235-a4c4-47f73e67d670 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:34.257228 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-86ad2446-ad96-41b3-93c5-657455a388ae req-84341ad0-4958-4235-a4c4-47f73e67d670 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.1001029
May 31 16:23:34.317173 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-86ad2446-ad96-41b3-93c5-657455a388ae req-8df42964-f099-4ae5-a5bc-dbc54e86e7b2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0590527
May 31 16:23:34.895022 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c87b161-765f-46c0-b085-a6066053df13 req-a4e587b6-570d-41ee-b833-d9abdcb2930a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:34.896724 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7c87b161-765f-46c0-b085-a6066053df13 req-a4e587b6-570d-41ee-b833-d9abdcb2930a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.0978863
May 31 16:23:34.949769 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7c87b161-765f-46c0-b085-a6066053df13 req-12376577-c35d-45ac-a267-48c24acda1be tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0469246
May 31 16:23:35.010425 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-02634849-53a3-4f16-bb37-e192e4044fea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:35.241770 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52179fdb-4db1-4ab2-948d-d7b229428860 req-1a649830-5cb1-40ca-a844-d145efe616b8 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:35.244732 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-52179fdb-4db1-4ab2-948d-d7b229428860 req-1a649830-5cb1-40ca-a844-d145efe616b8 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.1345208
May 31 16:23:35.298560 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-52179fdb-4db1-4ab2-948d-d7b229428860 req-7bffc08b-c134-47ff-be1c-27c2b88aa781 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0470250
May 31 16:23:35.540152 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ade487cb-ea85-4510-8d0b-366ca7fc3d32 req-251926ee-b6dc-4074-a518-6958d113c080 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:35.541654 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ade487cb-ea85-4510-8d0b-366ca7fc3d32 req-251926ee-b6dc-4074-a518-6958d113c080 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.1108556
May 31 16:23:35.592868 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ade487cb-ea85-4510-8d0b-366ca7fc3d32 req-e277d214-e614-46f3-8927-08e1766fd8e6 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0449746
May 31 16:23:36.178110 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b49e750d-b88d-4f03-9745-bc3f2d2dbb68 req-bcfc40bf-9342-4e1e-9a72-470154048136 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:36.179889 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b49e750d-b88d-4f03-9745-bc3f2d2dbb68 req-bcfc40bf-9342-4e1e-9a72-470154048136 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.1014574
May 31 16:23:36.229423 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b49e750d-b88d-4f03-9745-bc3f2d2dbb68 req-b2721fcd-69af-4c35-8641-7c50d8d2e7b3 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0429161
May 31 16:23:36.658374 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfed5df3-9d39-4100-aaa2-b9b5540f049b req-ad260156-29a3-4d84-bad9-0a5bc0859c60 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:36.659898 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cfed5df3-9d39-4100-aaa2-b9b5540f049b req-ad260156-29a3-4d84-bad9-0a5bc0859c60 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.0870385
May 31 16:23:36.713831 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cfed5df3-9d39-4100-aaa2-b9b5540f049b req-a78c3974-60c4-4492-b1a5-78ef99ea0d41 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0440924
May 31 16:23:36.804770 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97f16317-7492-4704-ba55-235dd1a6f4b7 req-cc7caed9-44d3-4af6-9bfa-fccb7a740d0e tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:36.807286 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-97f16317-7492-4704-ba55-235dd1a6f4b7 req-cc7caed9-44d3-4af6-9bfa-fccb7a740d0e tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.0971484
May 31 16:23:36.853610 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-97f16317-7492-4704-ba55-235dd1a6f4b7 req-72878440-cf16-42ff-9343-a569bd9dcf0d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0414679
May 31 16:23:37.430824 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9c51789-0e9e-4d38-a213-37849dbf664d req-b971aa61-1c77-49b3-89e4-e91e1e599197 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:37.432393 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d9c51789-0e9e-4d38-a213-37849dbf664d req-b971aa61-1c77-49b3-89e4-e91e1e599197 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.0848100
May 31 16:23:37.486549 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d9c51789-0e9e-4d38-a213-37849dbf664d req-9b2b3f3b-86f1-4cd6-be44-75f5d0b5c257 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0446520
May 31 16:23:37.903695 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:37.955137 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-199955ac-943e-4525-8af1-053455fffd94 req-289d5c2b-4979-43ba-8ac9-17885d5a41ad tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:37.956632 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-199955ac-943e-4525-8af1-053455fffd94 req-289d5c2b-4979-43ba-8ac9-17885d5a41ad tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.0972052
May 31 16:23:38.061652 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-199955ac-943e-4525-8af1-053455fffd94 req-2795116a-535c-4b4e-9d6d-e44210b83583 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0973487
May 31 16:23:38.091054 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d189d2fa-1940-4c04-9a88-384854feb57d req-fbe3bfa8-c5ae-4934-8013-6b485909c95f tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:38.092553 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d189d2fa-1940-4c04-9a88-384854feb57d req-fbe3bfa8-c5ae-4934-8013-6b485909c95f tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.1142673
May 31 16:23:38.145914 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d189d2fa-1940-4c04-9a88-384854feb57d req-0e1f4ab3-aa9c-4733-be95-5f1a0b808e0d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0463295
May 31 16:23:38.216162 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-ae4b5ba3-b4a1-4b4d-9161-a67e324e8741 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:38.684250 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5d44293-d26c-4bf6-9b3e-60acc30537d3 req-26cdfd04-941f-4a89-b418-fa420abb2b4c tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:38.685567 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b5d44293-d26c-4bf6-9b3e-60acc30537d3 req-26cdfd04-941f-4a89-b418-fa420abb2b4c tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.0857272
May 31 16:23:38.735196 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b5d44293-d26c-4bf6-9b3e-60acc30537d3 req-a83c0f9d-4796-43d9-9205-1563a4859fdc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0431330
May 31 16:23:39.147540 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:39.414618 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57008f79-f20f-4b90-999d-5d08c7b0070b req-6613d535-4872-4446-82e5-2b284fde3a1e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:39.416035 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-57008f79-f20f-4b90-999d-5d08c7b0070b req-6613d535-4872-4446-82e5-2b284fde3a1e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.2382760
May 31 16:23:39.428329 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-238a90e7-cbc7-41e2-885a-15f229746510 req-c3e194d2-860e-4185-bcbc-7e0850b42fae tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:39.429662 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-238a90e7-cbc7-41e2-885a-15f229746510 req-c3e194d2-860e-4185-bcbc-7e0850b42fae tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.1208863
May 31 16:23:39.501554 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-57008f79-f20f-4b90-999d-5d08c7b0070b req-6a351968-5626-42e6-9a29-d5cbd6b57da2 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0707119
May 31 16:23:39.509314 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-238a90e7-cbc7-41e2-885a-15f229746510 req-30a1577e-4996-4aa5-b57a-30e2a0f2d60b tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0657315
May 31 16:23:39.972339 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccdb381a-16a6-4fa5-8e7b-d0b98af9ffaa req-e6fbfae0-9412-44f5-afb1-9a29d386adfa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:39.973805 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ccdb381a-16a6-4fa5-8e7b-d0b98af9ffaa req-e6fbfae0-9412-44f5-afb1-9a29d386adfa service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=8e66b29e29094a429643e0308704753b&device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 1137 time: 0.2042682
May 31 16:23:39.982798 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4be9034-ffab-4ec0-8cfa-07d69cbb827b req-1523bf67-8ea8-4ab1-8363-20c5873c396e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:39.984136 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b4be9034-ffab-4ec0-8cfa-07d69cbb827b req-1523bf67-8ea8-4ab1-8363-20c5873c396e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.63 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.1823156
May 31 16:23:40.011547 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e889543-c1b3-4476-9800-f8324aa55952 req-ab937446-b420-4fc7-98b5-7609bea7e221 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:40.013017 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2e889543-c1b3-4476-9800-f8324aa55952 req-ab937446-b420-4fc7-98b5-7609bea7e221 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.1583059
May 31 16:23:40.168868 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:23:40.215757 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2e889543-c1b3-4476-9800-f8324aa55952 req-a17e12a9-cab3-4c56-b438-38b464e1a92c tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1654875
May 31 16:23:40.269085 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccdb381a-16a6-4fa5-8e7b-d0b98af9ffaa req-1455e885-1055-4c9d-8e46-cdc36c347fb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:40.270627 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ccdb381a-16a6-4fa5-8e7b-d0b98af9ffaa req-1455e885-1055-4c9d-8e46-cdc36c347fb3 service neutron] 10.222.0.63 "GET /v2.0/networks?id=e3df5118-0a40-4a66-b31c-a978a0c899cf HTTP/1.1" status: 200  len: 915 time: 0.2843690
May 31 16:23:40.362373 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [req-b4be9034-ffab-4ec0-8cfa-07d69cbb827b req-33bb40e1-0551-4055-ad94-cb5f9fefc4d5 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Deleting port ed28e094-e3fd-4150-b73d-a9ce8dff7be4 {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:23:40.362704 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-b4be9034-ffab-4ec0-8cfa-07d69cbb827b req-33bb40e1-0551-4055-ad94-cb5f9fefc4d5 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:40.465542 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ccdb381a-16a6-4fa5-8e7b-d0b98af9ffaa req-58e72309-1330-419a-8ee4-e79c0c0f267a service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=747cd83a-69bc-48d9-8ba9-e9638b7be825 HTTP/1.1" status: 200  len: 1001 time: 0.1861703
May 31 16:23:40.567449 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-b4be9034-ffab-4ec0-8cfa-07d69cbb827b req-33bb40e1-0551-4055-ad94-cb5f9fefc4d5 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] For port ed28e094-e3fd-4150-b73d-a9ce8dff7be4, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=ed28e094-e3fd-4150-b73d-a9ce8dff7be4,segment=NetworkSegment(016e9daa-b906-4ec8-978d-cb58fbcd78da),segment_id=016e9daa-b906-4ec8-978d-cb58fbcd78da)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:23:40.567806 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-b4be9034-ffab-4ec0-8cfa-07d69cbb827b req-33bb40e1-0551-4055-ad94-cb5f9fefc4d5 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:40.580829 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccdb381a-16a6-4fa5-8e7b-d0b98af9ffaa req-c0c3789f-fcef-41dc-9543-6e772fd17d07 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:40.582296 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ccdb381a-16a6-4fa5-8e7b-d0b98af9ffaa req-c0c3789f-fcef-41dc-9543-6e772fd17d07 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=1a675b0f-478f-47e0-acdd-51bacffe39b6 HTTP/1.1" status: 200  len: 853 time: 0.1077700
May 31 16:23:40.801891 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [req-b4be9034-ffab-4ec0-8cfa-07d69cbb827b req-33bb40e1-0551-4055-ad94-cb5f9fefc4d5 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Calling delete_port for ed28e094-e3fd-4150-b73d-a9ce8dff7be4 owned by compute:nova {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:23:40.853670 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:40.940742 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccdb381a-16a6-4fa5-8e7b-d0b98af9ffaa req-a8b0b07e-fd98-4197-b991-f245e170d0e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:40.942217 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ccdb381a-16a6-4fa5-8e7b-d0b98af9ffaa req-a8b0b07e-fd98-4197-b991-f245e170d0e0 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=e3df5118-0a40-4a66-b31c-a978a0c899cf&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3041496
May 31 16:23:40.949423 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17276019-63dd-4f09-9b7f-3103f29c606e req-fd997a6e-1a2a-453b-8471-a74861e77d68 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:40.950858 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-17276019-63dd-4f09-9b7f-3103f29c606e req-fd997a6e-1a2a-453b-8471-a74861e77d68 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.3147831
May 31 16:23:40.958872 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac6b0cc8-85cb-4cd5-a9d5-5a0386982d8a req-9aca6bc3-be12-4add-9630-dea632494cd4 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:40.960348 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ac6b0cc8-85cb-4cd5-a9d5-5a0386982d8a req-9aca6bc3-be12-4add-9630-dea632494cd4 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 943 time: 0.3231301
May 31 16:23:41.140988 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e8b6060-d968-41ee-a89f-6351f615900f req-07dfbe2c-bb82-44e0-a845-266a3a46e3a5 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:41.142549 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-7e8b6060-d968-41ee-a89f-6351f615900f req-07dfbe2c-bb82-44e0-a845-266a3a46e3a5 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Synchronizing usage tracker for tenant:1739d3c0e2734c8a9af5c5291aac8e25 on resource:port {{(pid=91763) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:23:41.155646 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-7e8b6060-d968-41ee-a89f-6351f615900f req-07dfbe2c-bb82-44e0-a845-266a3a46e3a5 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Unset dirty status for tenant:1739d3c0e2734c8a9af5c5291aac8e25 on resource:port {{(pid=91763) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:23:41.156816 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7e8b6060-d968-41ee-a89f-6351f615900f req-07dfbe2c-bb82-44e0-a845-266a3a46e3a5 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.63 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 945 time: 0.1046679
May 31 16:23:41.270782 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ac6b0cc8-85cb-4cd5-a9d5-5a0386982d8a req-132aa67b-6ff4-48dd-8531-24cb22d23fb2 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2861073
May 31 16:23:41.273309 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-17276019-63dd-4f09-9b7f-3103f29c606e req-ca20d532-856e-4fc9-b294-0024bbf8f99c tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3110545
May 31 16:23:41.308878 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-7e8b6060-d968-41ee-a89f-6351f615900f req-6301fd54-4719-4b13-9890-2b9dec06b9f6 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Deleting port 24196a14-22d0-4d09-9fa7-16d524809d92 {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:23:41.308878 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7e8b6060-d968-41ee-a89f-6351f615900f req-6301fd54-4719-4b13-9890-2b9dec06b9f6 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:41.325274 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-b4be9034-ffab-4ec0-8cfa-07d69cbb827b req-33bb40e1-0551-4055-ad94-cb5f9fefc4d5 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:41.336001 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-59078d5e-7ee0-41b6-8fd1-d29ac85413fe tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:41.341027 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['5591c8db-5905-4285-84f7-5743de100fc2', 'a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9', 'a94146eb-55eb-45df-b975-f2732f9d455d'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:23:41.389828 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ccdb381a-16a6-4fa5-8e7b-d0b98af9ffaa req-bfe80cb5-2b65-417d-a48a-191944d9f54c service neutron] 10.222.0.63 "GET /v2.0/networks/e3df5118-0a40-4a66-b31c-a978a0c899cf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4284947
May 31 16:23:41.392781 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33bb40e1-0551-4055-ad94-cb5f9fefc4d5 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Pushing event deleted for resources: {'Port': ['ID=ed28e094-e3fd-4150-b73d-a9ce8dff7be4,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:41.430185 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-33bb40e1-0551-4055-ad94-cb5f9fefc4d5 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:41.452127 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-7e8b6060-d968-41ee-a89f-6351f615900f req-6301fd54-4719-4b13-9890-2b9dec06b9f6 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] For port 24196a14-22d0-4d09-9fa7-16d524809d92, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=24196a14-22d0-4d09-9fa7-16d524809d92,segment=NetworkSegment(5a3941ae-d5de-4802-8fd8-3da6c1932b05),segment_id=5a3941ae-d5de-4802-8fd8-3da6c1932b05)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:23:41.452494 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7e8b6060-d968-41ee-a89f-6351f615900f req-6301fd54-4719-4b13-9890-2b9dec06b9f6 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:41.589568 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-7e8b6060-d968-41ee-a89f-6351f615900f req-6301fd54-4719-4b13-9890-2b9dec06b9f6 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Calling delete_port for 24196a14-22d0-4d09-9fa7-16d524809d92 owned by compute:nova {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:23:41.597009 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [req-b4be9034-ffab-4ec0-8cfa-07d69cbb827b req-33bb40e1-0551-4055-ad94-cb5f9fefc4d5 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] No DVR routers for this DVR port ed28e094-e3fd-4150-b73d-a9ce8dff7be4 on host hv-cinder-79381 {{(pid=91764) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:23:41.615796 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-b4be9034-ffab-4ec0-8cfa-07d69cbb827b req-33bb40e1-0551-4055-ad94-cb5f9fefc4d5 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:41.620257 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '69990510-6c38-4988-a0ec-18ae79233830', 'name': 'network-vif-deleted', 'tag': 'ed28e094-e3fd-4150-b73d-a9ce8dff7be4'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:23:41.632814 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a8154f9a-2354-4483-8f85-7b09b5f96366" -d '{"events": [{"server_uuid": "69990510-6c38-4988-a0ec-18ae79233830", "name": "network-vif-deleted", "tag": "ed28e094-e3fd-4150-b73d-a9ce8dff7be4"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:23:41.681021 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b4be9034-ffab-4ec0-8cfa-07d69cbb827b req-33bb40e1-0551-4055-ad94-cb5f9fefc4d5 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.63 "DELETE /v2.0/ports/ed28e094-e3fd-4150-b73d-a9ce8dff7be4 HTTP/1.1" status: 204  len: 173 time: 1.6669812
May 31 16:23:41.740037 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:23:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f1304057-14cb-409c-bee5-ceb8d461f9b2 x-openstack-request-id: req-f1304057-14cb-409c-bee5-ceb8d461f9b2 {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:23:41.740521 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "69990510-6c38-4988-a0ec-18ae79233830", "name": "network-vif-deleted", "tag": "ed28e094-e3fd-4150-b73d-a9ce8dff7be4", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:23:41.741042 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-f1304057-14cb-409c-bee5-ceb8d461f9b2 {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:23:41.741596 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '69990510-6c38-4988-a0ec-18ae79233830', 'name': 'network-vif-deleted', 'tag': 'ed28e094-e3fd-4150-b73d-a9ce8dff7be4', 'status': 'completed', 'code': 200}
May 31 16:23:41.743879 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ccdb381a-16a6-4fa5-8e7b-d0b98af9ffaa req-bcea1d6a-8adf-424d-bc71-46fc506982bf service neutron] 10.222.0.63 "GET /v2.0/networks/e3df5118-0a40-4a66-b31c-a978a0c899cf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3213542
May 31 16:23:41.754114 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7492550f-366f-4b1d-a7fa-4b7ff2a2f4b1 req-cdd60bf0-c0ae-4e70-a9f7-b6aed82269e2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:41.762550 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7492550f-366f-4b1d-a7fa-4b7ff2a2f4b1 req-cdd60bf0-c0ae-4e70-a9f7-b6aed82269e2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.3409460
May 31 16:23:41.774777 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7e8b6060-d968-41ee-a89f-6351f615900f req-6301fd54-4719-4b13-9890-2b9dec06b9f6 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:41.788241 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:41.817016 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7492550f-366f-4b1d-a7fa-4b7ff2a2f4b1 req-fcf3ba98-9092-47f9-ab30-61dbb97912de tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0535824
May 31 16:23:41.843573 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6301fd54-4719-4b13-9890-2b9dec06b9f6 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Pushing event deleted for resources: {'Port': ['ID=24196a14-22d0-4d09-9fa7-16d524809d92,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:41.879631 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-6301fd54-4719-4b13-9890-2b9dec06b9f6 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:41.922946 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [req-7e8b6060-d968-41ee-a89f-6351f615900f req-6301fd54-4719-4b13-9890-2b9dec06b9f6 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] No DVR routers for this DVR port 24196a14-22d0-4d09-9fa7-16d524809d92 on host hv-cinder-79381 {{(pid=91763) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:23:41.926010 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7e8b6060-d968-41ee-a89f-6351f615900f req-6301fd54-4719-4b13-9890-2b9dec06b9f6 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:41.928599 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0d168a96-4a64-43eb-9f13-103e7383f6c0', 'name': 'network-vif-deleted', 'tag': '24196a14-22d0-4d09-9fa7-16d524809d92'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:23:41.930892 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5dd5c025-d056-4a32-a43b-779be01bf29e" -d '{"events": [{"server_uuid": "0d168a96-4a64-43eb-9f13-103e7383f6c0", "name": "network-vif-deleted", "tag": "24196a14-22d0-4d09-9fa7-16d524809d92"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:23:41.944386 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7e8b6060-d968-41ee-a89f-6351f615900f req-6301fd54-4719-4b13-9890-2b9dec06b9f6 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.63 "DELETE /v2.0/ports/24196a14-22d0-4d09-9fa7-16d524809d92 HTTP/1.1" status: 204  len: 173 time: 0.7793169
May 31 16:23:41.979593 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:23:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0e24697b-427a-4835-885d-309b58c6c254 x-openstack-request-id: req-0e24697b-427a-4835-885d-309b58c6c254 {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:23:41.980142 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0d168a96-4a64-43eb-9f13-103e7383f6c0", "name": "network-vif-deleted", "tag": "24196a14-22d0-4d09-9fa7-16d524809d92", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:23:41.980424 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-0e24697b-427a-4835-885d-309b58c6c254 {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:23:41.981036 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0d168a96-4a64-43eb-9f13-103e7383f6c0', 'name': 'network-vif-deleted', 'tag': '24196a14-22d0-4d09-9fa7-16d524809d92', 'status': 'completed', 'code': 200}
May 31 16:23:42.485970 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-f3785c2f-9ac8-48d6-baef-2274bf67285e req-04d3ce22-d3b2-4086-bfc6-46b10d6a17f8 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Synchronizing usage tracker for tenant:0eb6e65b3f844417816fb1e5c88a8004 on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:23:42.495298 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3fc07a4e-0e48-443b-a9af-1db46ae20b26 req-72e82b81-4047-43a2-a3ba-597b68e8c223 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=0d168a96-4a64-43eb-9f13-103e7383f6c0 HTTP/1.1" status: 200  len: 210 time: 0.0545053
May 31 16:23:42.509384 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-f3785c2f-9ac8-48d6-baef-2274bf67285e req-04d3ce22-d3b2-4086-bfc6-46b10d6a17f8 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Unset dirty status for tenant:0eb6e65b3f844417816fb1e5c88a8004 on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:23:42.510624 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f3785c2f-9ac8-48d6-baef-2274bf67285e req-04d3ce22-d3b2-4086-bfc6-46b10d6a17f8 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=69990510-6c38-4988-a0ec-18ae79233830 HTTP/1.1" status: 200  len: 210 time: 0.1083720
May 31 16:23:43.028957 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-645863ab-fabe-4384-91d9-33a6d12f23ed req-4fbf3eab-5f20-4c78-8c66-3834944eb3a8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:43.030499 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-645863ab-fabe-4384-91d9-33a6d12f23ed req-4fbf3eab-5f20-4c78-8c66-3834944eb3a8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.0910754
May 31 16:23:43.078412 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-645863ab-fabe-4384-91d9-33a6d12f23ed req-9e5b5e41-7a8e-46ee-b326-2083fb3ec6e7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0414381
May 31 16:23:43.098885 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['f99df66c-c850-4d01-80ae-3d312eee69db', '24196a14-22d0-4d09-9fa7-16d524809d92'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:23:43.986665 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29bc1424-d0d0-45e1-8c7a-003d4faaaf0b req-908f0cd5-7903-4e2a-9060-d8f0e7a9b503 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:43.988165 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-29bc1424-d0d0-45e1-8c7a-003d4faaaf0b req-908f0cd5-7903-4e2a-9060-d8f0e7a9b503 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.0873616
May 31 16:23:44.035010 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-29bc1424-d0d0-45e1-8c7a-003d4faaaf0b req-e4f357ce-cd33-4f5c-876f-868338ad58b5 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411146
May 31 16:23:44.296260 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92a0d9d0-3023-40c7-a554-a015bf7c6d11 req-36906841-ba2e-46ef-8a38-787ca309a6c4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:44.297804 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-92a0d9d0-3023-40c7-a554-a015bf7c6d11 req-36906841-ba2e-46ef-8a38-787ca309a6c4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.0915477
May 31 16:23:44.346954 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-92a0d9d0-3023-40c7-a554-a015bf7c6d11 req-3037a4e1-4f05-4ab4-91fb-4defed35a625 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0428104
May 31 16:23:45.288252 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716b22c4-b464-4992-8b51-b8f54c6c6ef1 req-2f6640d2-17a8-4356-9c0e-3048209076fa tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:45.289719 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-716b22c4-b464-4992-8b51-b8f54c6c6ef1 req-2f6640d2-17a8-4356-9c0e-3048209076fa tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.1411686
May 31 16:23:45.305955 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d9cf489-f9c7-4f31-a977-4b690973c583 req-d10c7ce8-e654-4cd2-b7ba-16629c0daf78 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:45.307459 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0d9cf489-f9c7-4f31-a977-4b690973c583 req-d10c7ce8-e654-4cd2-b7ba-16629c0daf78 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=618a73da-df70-4028-8443-ff8667721881 HTTP/1.1" status: 200  len: 945 time: 0.1267612
May 31 16:23:45.385157 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0d9cf489-f9c7-4f31-a977-4b690973c583 req-f1fe3888-3631-4d25-af3a-dd31cb9295cd tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0598171
May 31 16:23:45.387844 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-716b22c4-b464-4992-8b51-b8f54c6c6ef1 req-7e1f1c47-c968-4fab-9b7a-1ce8399da741 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0794821
May 31 16:23:45.582755 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b626d33-15d0-46aa-9257-c59284babb9c req-66539e0a-5664-4797-a751-d65fc5ddfcc2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:45.584671 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6b626d33-15d0-46aa-9257-c59284babb9c req-66539e0a-5664-4797-a751-d65fc5ddfcc2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.0928485
May 31 16:23:45.633172 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6b626d33-15d0-46aa-9257-c59284babb9c req-70fd1067-02e3-4e16-b8c7-ee62f01788a1 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0425751
May 31 16:23:46.641156 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 24196a14-22d0-4d09-9fa7-16d524809d92 no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:23:46.646570 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2535902f-6552-43d7-982c-41ad995bbdce req-5d7af01b-58c8-4ff3-acab-750c44a96b18 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:46.648105 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2535902f-6552-43d7-982c-41ad995bbdce req-5d7af01b-58c8-4ff3-acab-750c44a96b18 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=618a73da-df70-4028-8443-ff8667721881 HTTP/1.1" status: 200  len: 945 time: 0.1464841
May 31 16:23:46.656931 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef90a5a5-7870-4704-8026-f9e868583ab1 req-dc8a7b36-5342-4267-912b-20028eac2e9d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:46.658446 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ef90a5a5-7870-4704-8026-f9e868583ab1 req-dc8a7b36-5342-4267-912b-20028eac2e9d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.1225393
May 31 16:23:46.681917 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] No Port match for: 24196a14-22d0-4d09-9fa7-16d524809d92 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:23:46.682269 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 24196a14-22d0-4d09-9fa7-16d524809d92 not bound to the agent host hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:23:46.732993 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2535902f-6552-43d7-982c-41ad995bbdce req-8b99516d-b86f-4fd1-a4c6-12658f7bf63f tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0729373
May 31 16:23:46.737360 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ef90a5a5-7870-4704-8026-f9e868583ab1 req-2dc7f040-3552-47ee-a42e-7618f40bc45d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0643692
May 31 16:23:46.914076 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84ab2f83-0957-4068-8e95-ec62696295f4 req-bf29c7cc-de08-42ca-8807-d3b9d76946b2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:46.915591 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-84ab2f83-0957-4068-8e95-ec62696295f4 req-bf29c7cc-de08-42ca-8807-d3b9d76946b2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.0860300
May 31 16:23:46.964628 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-84ab2f83-0957-4068-8e95-ec62696295f4 req-39d1847d-c8a2-45de-9aac-3395728711dc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0430386
May 31 16:23:47.611607 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f18100b1-e539-4b50-8216-14c93c8d88d8 req-1742d598-e700-4f97-8df6-1829e3069503 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:47.612882 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-f18100b1-e539-4b50-8216-14c93c8d88d8 req-1742d598-e700-4f97-8df6-1829e3069503 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Synchronizing usage tracker for tenant:0eb6e65b3f844417816fb1e5c88a8004 on resource:port {{(pid=91763) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:23:47.624887 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-f18100b1-e539-4b50-8216-14c93c8d88d8 req-1742d598-e700-4f97-8df6-1829e3069503 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Unset dirty status for tenant:0eb6e65b3f844417816fb1e5c88a8004 on resource:port {{(pid=91763) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:23:47.626037 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-f18100b1-e539-4b50-8216-14c93c8d88d8 req-1742d598-e700-4f97-8df6-1829e3069503 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.63 "GET /v2.0/ports?device_id=618a73da-df70-4028-8443-ff8667721881 HTTP/1.1" status: 200  len: 945 time: 0.0939991
May 31 16:23:47.859931 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-f18100b1-e539-4b50-8216-14c93c8d88d8 req-03d94c5a-956b-4893-95f1-155dda05f930 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Deleting port a94146eb-55eb-45df-b975-f2732f9d455d {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:23:47.860372 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-f18100b1-e539-4b50-8216-14c93c8d88d8 req-03d94c5a-956b-4893-95f1-155dda05f930 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:47.953114 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0591b125-96bb-480c-a8ae-7ccc4e9b6f85 req-d48ea512-09f2-4aab-9e3f-0931f720e7dc tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:47.954667 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0591b125-96bb-480c-a8ae-7ccc4e9b6f85 req-d48ea512-09f2-4aab-9e3f-0931f720e7dc tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=618a73da-df70-4028-8443-ff8667721881 HTTP/1.1" status: 200  len: 945 time: 0.0922458
May 31 16:23:48.021882 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-f18100b1-e539-4b50-8216-14c93c8d88d8 req-03d94c5a-956b-4893-95f1-155dda05f930 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] For port a94146eb-55eb-45df-b975-f2732f9d455d, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=a94146eb-55eb-45df-b975-f2732f9d455d,segment=NetworkSegment(016e9daa-b906-4ec8-978d-cb58fbcd78da),segment_id=016e9daa-b906-4ec8-978d-cb58fbcd78da)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:23:48.022253 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-f18100b1-e539-4b50-8216-14c93c8d88d8 req-03d94c5a-956b-4893-95f1-155dda05f930 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:48.034795 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0591b125-96bb-480c-a8ae-7ccc4e9b6f85 req-1416ab7a-9af5-43c7-a59a-cc37ae783d97 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0741074
May 31 16:23:48.211918 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-f18100b1-e539-4b50-8216-14c93c8d88d8 req-03d94c5a-956b-4893-95f1-155dda05f930 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Calling delete_port for a94146eb-55eb-45df-b975-f2732f9d455d owned by compute:nova {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:23:48.349806 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-f18100b1-e539-4b50-8216-14c93c8d88d8 req-03d94c5a-956b-4893-95f1-155dda05f930 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:48.364965 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:48.369417 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['5591c8db-5905-4285-84f7-5743de100fc2', 'a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9', 'a94146eb-55eb-45df-b975-f2732f9d455d'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:23:48.468949 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fafeac35-98e4-47f8-a569-0be303dc39a1 req-4d64ca82-8c03-491e-a658-2bf2b0322941 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:48.477538 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-fafeac35-98e4-47f8-a569-0be303dc39a1 req-4d64ca82-8c03-491e-a658-2bf2b0322941 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.2621944
May 31 16:23:48.506932 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19c46468-9a60-468a-81fb-1e096caf7d25 req-e05604d6-f687-4061-ab49-609016937b7a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:48.508661 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-19c46468-9a60-468a-81fb-1e096caf7d25 req-e05604d6-f687-4061-ab49-609016937b7a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 944 time: 0.3283176
May 31 16:23:48.515789 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03d94c5a-956b-4893-95f1-155dda05f930 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Pushing event deleted for resources: {'Port': ['ID=a94146eb-55eb-45df-b975-f2732f9d455d,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:48.522929 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-03d94c5a-956b-4893-95f1-155dda05f930 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:48.523830 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [req-f18100b1-e539-4b50-8216-14c93c8d88d8 req-03d94c5a-956b-4893-95f1-155dda05f930 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] No DVR routers for this DVR port a94146eb-55eb-45df-b975-f2732f9d455d on host hv-cinder-79381 {{(pid=91763) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:23:48.526334 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-f18100b1-e539-4b50-8216-14c93c8d88d8 req-03d94c5a-956b-4893-95f1-155dda05f930 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:48.536494 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '618a73da-df70-4028-8443-ff8667721881', 'name': 'network-vif-deleted', 'tag': 'a94146eb-55eb-45df-b975-f2732f9d455d'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:23:48.539432 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2fffd750-3f7d-4825-be52-36b52a209dcc" -d '{"events": [{"server_uuid": "618a73da-df70-4028-8443-ff8667721881", "name": "network-vif-deleted", "tag": "a94146eb-55eb-45df-b975-f2732f9d455d"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:23:48.544038 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-f18100b1-e539-4b50-8216-14c93c8d88d8 req-03d94c5a-956b-4893-95f1-155dda05f930 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.63 "DELETE /v2.0/ports/a94146eb-55eb-45df-b975-f2732f9d455d HTTP/1.1" status: 204  len: 173 time: 0.9065506
May 31 16:23:48.573151 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-fafeac35-98e4-47f8-a569-0be303dc39a1 req-390d9d74-edfd-4cff-9b75-12efacaeebbe tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0945778
May 31 16:23:48.586258 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-19c46468-9a60-468a-81fb-1e096caf7d25 req-cf053f24-533e-400d-9931-779d5044fa33 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0668070
May 31 16:23:48.654932 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:23:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c83806d4-dcd2-4a1b-9bb1-2b88b690f4f6 x-openstack-request-id: req-c83806d4-dcd2-4a1b-9bb1-2b88b690f4f6 {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:23:48.655750 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "618a73da-df70-4028-8443-ff8667721881", "name": "network-vif-deleted", "tag": "a94146eb-55eb-45df-b975-f2732f9d455d", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:23:48.655750 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-c83806d4-dcd2-4a1b-9bb1-2b88b690f4f6 {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:23:48.656746 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '618a73da-df70-4028-8443-ff8667721881', 'name': 'network-vif-deleted', 'tag': 'a94146eb-55eb-45df-b975-f2732f9d455d', 'status': 'completed', 'code': 200}
May 31 16:23:48.672007 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 8cf870c7-bdf1-490f-adfa-61e27997bc91 details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:23:48.880782 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 8cf870c7-bdf1-490f-adfa-61e27997bc91, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=8cf870c7-bdf1-490f-adfa-61e27997bc91,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:23:48.899925 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': '8cf870c7-bdf1-490f-adfa-61e27997bc91', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'port_id': '8cf870c7-bdf1-490f-adfa-61e27997bc91', 'mac_address': 'fa:16:3e:b1:f3:43', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 806, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:23:48.958231 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:48.974990 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8cf870c7-bdf1-490f-adfa-61e27997bc91 {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:23:48.991531 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 8cf870c7-bdf1-490f-adfa-61e27997bc91, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=8cf870c7-bdf1-490f-adfa-61e27997bc91,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:23:48.995356 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:48.997101 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:49.069912 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=8cf870c7-bdf1-490f-adfa-61e27997bc91,revision_number=9']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:49.072915 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:49.203193 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-eef14793-286f-4bdc-854d-c73ed81844ad req-46e30db4-b208-432e-b322-44630c811042 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=618a73da-df70-4028-8443-ff8667721881 HTTP/1.1" status: 200  len: 210 time: 0.0480940
May 31 16:23:49.480937 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['8cf870c7-bdf1-490f-adfa-61e27997bc91'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:23:49.637384 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:49.865349 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5264fb6c-0a94-4ebe-8e5a-fa94ad0671c5 req-21209271-78c1-4e50-a269-2f99e1a92c3a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:49.866840 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5264fb6c-0a94-4ebe-8e5a-fa94ad0671c5 req-21209271-78c1-4e50-a269-2f99e1a92c3a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 945 time: 0.1424198
May 31 16:23:49.874460 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48a38919-6a1b-42e6-87a7-9ac436a11126 req-6a457bba-dd9f-4d12-9a53-00d6d3ae141d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:49.875795 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-48a38919-6a1b-42e6-87a7-9ac436a11126 req-6a457bba-dd9f-4d12-9a53-00d6d3ae141d tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.1494212
May 31 16:23:49.952372 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5264fb6c-0a94-4ebe-8e5a-fa94ad0671c5 req-bc94c1ad-6941-49aa-b86f-35167f7416c6 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0755315
May 31 16:23:49.959745 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-48a38919-6a1b-42e6-87a7-9ac436a11126 req-b0b21379-491c-4acb-8631-de9b2c139d6e tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0676756
May 31 16:23:50.651123 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0e84bab-8e25-4e17-b5af-0f0dd457eb13 req-db092e12-b815-4f31-bb77-b49016dd9f13 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:50.652544 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e0e84bab-8e25-4e17-b5af-0f0dd457eb13 req-db092e12-b815-4f31-bb77-b49016dd9f13 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 945 time: 0.0790708
May 31 16:23:50.678655 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 8cf870c7-bdf1-490f-adfa-61e27997bc91 up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:23:50.698986 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e0e84bab-8e25-4e17-b5af-0f0dd457eb13 req-7f08ca55-8a0a-4f9f-920c-04c4927fe695 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408370
May 31 16:23:50.750953 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port 8cf870c7-bdf1-490f-adfa-61e27997bc91 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:23:50.751337 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:50.874890 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:50.903202 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '236769ac-e375-4497-9fe7-7425ccc79d09', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8cf870c7-bdf1-490f-adfa-61e27997bc91'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:23:50.905457 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f35dff3-2be3-4a61-b15a-284c3fdba668" -d '{"events": [{"server_uuid": "236769ac-e375-4497-9fe7-7425ccc79d09", "name": "network-vif-plugged", "status": "completed", "tag": "8cf870c7-bdf1-490f-adfa-61e27997bc91"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:23:50.914033 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 8cf870c7-bdf1-490f-adfa-61e27997bc91, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=8cf870c7-bdf1-490f-adfa-61e27997bc91,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:23:50.918752 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:50.919855 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device a94146eb-55eb-45df-b975-f2732f9d455d no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:23:50.949885 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2276730f-71b6-41f9-8b61-f799e5de6a6a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:50.962612 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 34214) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:23:51.018488 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:23:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-da007119-e116-4edf-bc21-bb220bcdbaf2 x-openstack-request-id: req-da007119-e116-4edf-bc21-bb220bcdbaf2 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:23:51.018792 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "236769ac-e375-4497-9fe7-7425ccc79d09", "name": "network-vif-plugged", "status": "completed", "tag": "8cf870c7-bdf1-490f-adfa-61e27997bc91", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:23:51.019057 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-da007119-e116-4edf-bc21-bb220bcdbaf2 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:23:51.019457 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '236769ac-e375-4497-9fe7-7425ccc79d09', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8cf870c7-bdf1-490f-adfa-61e27997bc91', 'code': 200}
May 31 16:23:51.028608 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=8cf870c7-bdf1-490f-adfa-61e27997bc91,revision_number=10']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:51.038544 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] No Port match for: a94146eb-55eb-45df-b975-f2732f9d455d {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:23:51.038975 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device a94146eb-55eb-45df-b975-f2732f9d455d not bound to the agent host hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:23:51.040696 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:51.108022 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-87c276b6-8eb3-44ac-9cb1-8d60ba0f3ef1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:51.125232 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-87c276b6-8eb3-44ac-9cb1-8d60ba0f3ef1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:23:51.131458 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-87c276b6-8eb3-44ac-9cb1-8d60ba0f3ef1 admin admin] Usage tracker for resource:security_group_rule and tenant:cf17cd37486e4acfbff60970bc8a094b is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:23:51.134778 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-87c276b6-8eb3-44ac-9cb1-8d60ba0f3ef1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:23:51.141827 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-87c276b6-8eb3-44ac-9cb1-8d60ba0f3ef1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:23:51.190978 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05f07e32-78d9-4c8a-badd-8127732b39a5 req-d4d3210a-dc46-4832-81af-7e93b82bd551 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:51.192717 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-05f07e32-78d9-4c8a-badd-8127732b39a5 req-d4d3210a-dc46-4832-81af-7e93b82bd551 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.0942588
May 31 16:23:51.236334 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-87c276b6-8eb3-44ac-9cb1-8d60ba0f3ef1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:51.241576 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-87c276b6-8eb3-44ac-9cb1-8d60ba0f3ef1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:51.243115 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-05f07e32-78d9-4c8a-badd-8127732b39a5 req-2d4c9c93-59c4-47d5-aff8-1ab4fe7220e2 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/security-groups?id=2ddff6af-58b8-4216-b12c-394bda88aeb3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421574
May 31 16:23:51.249805 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-31c5910f-53ec-46f1-b169-52a6bafc2962 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:51.294289 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87c276b6-8eb3-44ac-9cb1-8d60ba0f3ef1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ed8695a0-9a65-4c0e-8fd9-4755df90da31,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:51.297657 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-87c276b6-8eb3-44ac-9cb1-8d60ba0f3ef1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:51.301072 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-87c276b6-8eb3-44ac-9cb1-8d60ba0f3ef1 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=cf17cd37486e4acfbff60970bc8a094b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3372254
May 31 16:23:51.304385 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 34224) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:23:51.350532 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aa20292-0eb0-483b-89e6-2ed73898dee1 req-d317c57d-b96e-455f-bdfc-265c27eacd4e tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:51.352018 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8aa20292-0eb0-483b-89e6-2ed73898dee1 req-d317c57d-b96e-455f-bdfc-265c27eacd4e tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 947 time: 0.1078668
May 31 16:23:51.367770 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-86f42044-279f-458f-8918-e43b5d14d8f7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:51.395631 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-86f42044-279f-458f-8918-e43b5d14d8f7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:51.403715 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8aa20292-0eb0-483b-89e6-2ed73898dee1 req-2b7f5df6-6831-4db2-aa76-f8bbb43b3c28 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0451751
May 31 16:23:51.458550 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-86f42044-279f-458f-8918-e43b5d14d8f7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:51.465783 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-65e25d73-1d8e-46db-a79d-af6beb622d74 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:51.479016 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86f42044-279f-458f-8918-e43b5d14d8f7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed8695a0-9a65-4c0e-8fd9-4755df90da31,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:51.483245 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-86f42044-279f-458f-8918-e43b5d14d8f7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:51.494562 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-86f42044-279f-458f-8918-e43b5d14d8f7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:51.496435 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-86f42044-279f-458f-8918-e43b5d14d8f7 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/ed8695a0-9a65-4c0e-8fd9-4755df90da31 HTTP/1.1" status: 204  len: 168 time: 0.1897166
May 31 16:23:51.707932 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4207ff76-3673-47f8-b251-c8befb397701 req-38b0ebe0-05ef-45bf-816c-0519f8223297 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:51.708883 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-4207ff76-3673-47f8-b251-c8befb397701 req-38b0ebe0-05ef-45bf-816c-0519f8223297 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Synchronizing usage tracker for tenant:1739d3c0e2734c8a9af5c5291aac8e25 on resource:port {{(pid=91763) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:23:51.731363 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-4207ff76-3673-47f8-b251-c8befb397701 req-38b0ebe0-05ef-45bf-816c-0519f8223297 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Unset dirty status for tenant:1739d3c0e2734c8a9af5c5291aac8e25 on resource:port {{(pid=91763) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:23:51.732895 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-4207ff76-3673-47f8-b251-c8befb397701 req-38b0ebe0-05ef-45bf-816c-0519f8223297 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.63 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 946 time: 0.1332767
May 31 16:23:51.743876 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b10e1668-e0de-454a-86a8-8216a26fbc53 req-6b508026-57bf-4737-aefc-6cf19c2af936 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:51.748061 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b10e1668-e0de-454a-86a8-8216a26fbc53 req-6b508026-57bf-4737-aefc-6cf19c2af936 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 1100 time: 0.0957050
May 31 16:23:51.880533 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-4207ff76-3673-47f8-b251-c8befb397701 req-2c95a735-739e-4493-97d6-e6acd4274fda tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Deleting port f99df66c-c850-4d01-80ae-3d312eee69db {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:23:51.880876 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-4207ff76-3673-47f8-b251-c8befb397701 req-2c95a735-739e-4493-97d6-e6acd4274fda tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:51.895148 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b10e1668-e0de-454a-86a8-8216a26fbc53 req-0a984a07-bc3b-4aba-9e64-6326edadfbd1 service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1380358
May 31 16:23:51.952308 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-009b1aab-bc47-4e6b-b06d-63e994ecb82e req-d2b762d7-aa21-46ee-a1d9-f378c64bdde6 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:51.954114 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-009b1aab-bc47-4e6b-b06d-63e994ecb82e req-d2b762d7-aa21-46ee-a1d9-f378c64bdde6 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 945 time: 0.1279852
May 31 16:23:52.001274 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-009b1aab-bc47-4e6b-b06d-63e994ecb82e req-a561190f-9609-4bf6-b5d0-6af69f572593 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409071
May 31 16:23:52.025114 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-4207ff76-3673-47f8-b251-c8befb397701 req-2c95a735-739e-4493-97d6-e6acd4274fda tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] For port f99df66c-c850-4d01-80ae-3d312eee69db, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=f99df66c-c850-4d01-80ae-3d312eee69db,segment=NetworkSegment(5a3941ae-d5de-4802-8fd8-3da6c1932b05),segment_id=5a3941ae-d5de-4802-8fd8-3da6c1932b05)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:23:52.025666 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-4207ff76-3673-47f8-b251-c8befb397701 req-2c95a735-739e-4493-97d6-e6acd4274fda tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:52.155889 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-4207ff76-3673-47f8-b251-c8befb397701 req-2c95a735-739e-4493-97d6-e6acd4274fda tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Calling delete_port for f99df66c-c850-4d01-80ae-3d312eee69db owned by compute:nova {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:23:52.271820 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-4207ff76-3673-47f8-b251-c8befb397701 req-2c95a735-739e-4493-97d6-e6acd4274fda tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:52.277605 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:52.287079 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['f99df66c-c850-4d01-80ae-3d312eee69db'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:23:52.333168 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c95a735-739e-4493-97d6-e6acd4274fda tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Pushing event deleted for resources: {'Port': ['ID=f99df66c-c850-4d01-80ae-3d312eee69db,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:52.336465 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-2c95a735-739e-4493-97d6-e6acd4274fda tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:52.414296 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [req-4207ff76-3673-47f8-b251-c8befb397701 req-2c95a735-739e-4493-97d6-e6acd4274fda tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] No DVR routers for this DVR port f99df66c-c850-4d01-80ae-3d312eee69db on host hv-cinder-79381 {{(pid=91763) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:23:52.417709 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-4207ff76-3673-47f8-b251-c8befb397701 req-2c95a735-739e-4493-97d6-e6acd4274fda tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:52.420920 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b75c28e8-2e51-4a0b-b6bc-9e946d07877d', 'name': 'network-vif-deleted', 'tag': 'f99df66c-c850-4d01-80ae-3d312eee69db'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:23:52.423217 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-55bd5c0c-707d-4055-a592-56f4320fb46f" -d '{"events": [{"server_uuid": "b75c28e8-2e51-4a0b-b6bc-9e946d07877d", "name": "network-vif-deleted", "tag": "f99df66c-c850-4d01-80ae-3d312eee69db"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:23:52.441998 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-4207ff76-3673-47f8-b251-c8befb397701 req-2c95a735-739e-4493-97d6-e6acd4274fda tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.63 "DELETE /v2.0/ports/f99df66c-c850-4d01-80ae-3d312eee69db HTTP/1.1" status: 204  len: 173 time: 0.7021644
May 31 16:23:52.445501 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-83282a83-b9cf-4ecd-ba5f-3eb821f9319a req-8f1712fb-d850-4300-a001-24dff6a72002 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] 10.222.0.43 "GET /v2.0/ports?device_id=b75c28e8-2e51-4a0b-b6bc-9e946d07877d HTTP/1.1" status: 200  len: 210 time: 0.0456171
May 31 16:23:52.506595 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:23:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b76a3002-6b44-4e3b-adc8-1364c1f643e4 x-openstack-request-id: req-b76a3002-6b44-4e3b-adc8-1364c1f643e4 {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:23:52.507228 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b75c28e8-2e51-4a0b-b6bc-9e946d07877d", "name": "network-vif-deleted", "tag": "f99df66c-c850-4d01-80ae-3d312eee69db", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:23:52.507829 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-b76a3002-6b44-4e3b-adc8-1364c1f643e4 {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:23:52.508313 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b75c28e8-2e51-4a0b-b6bc-9e946d07877d', 'name': 'network-vif-deleted', 'tag': 'f99df66c-c850-4d01-80ae-3d312eee69db', 'status': 'completed', 'code': 200}
May 31 16:23:52.667506 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9bb102c-1fa0-4b65-b1c2-1b85a8a680f0 req-d79a303a-dbf6-4992-8871-d850a520c8c8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:52.668992 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c9bb102c-1fa0-4b65-b1c2-1b85a8a680f0 req-d79a303a-dbf6-4992-8871-d850a520c8c8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 947 time: 0.1114187
May 31 16:23:52.731582 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c9bb102c-1fa0-4b65-b1c2-1b85a8a680f0 req-2096d271-8399-4879-b9bb-bb366e98fb6d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0552013
May 31 16:23:52.782582 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cb25aee-a6f6-4b26-8086-2c8feb33505e req-54acde50-8ab6-4467-8296-27da62b6e3a5 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:52.783311 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-6cb25aee-a6f6-4b26-8086-2c8feb33505e req-54acde50-8ab6-4467-8296-27da62b6e3a5 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Synchronizing usage tracker for tenant:0eb6e65b3f844417816fb1e5c88a8004 on resource:port {{(pid=91763) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:23:52.800746 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-6cb25aee-a6f6-4b26-8086-2c8feb33505e req-54acde50-8ab6-4467-8296-27da62b6e3a5 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Unset dirty status for tenant:0eb6e65b3f844417816fb1e5c88a8004 on resource:port {{(pid=91763) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:23:52.801982 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-6cb25aee-a6f6-4b26-8086-2c8feb33505e req-54acde50-8ab6-4467-8296-27da62b6e3a5 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.63 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 945 time: 0.1918974
May 31 16:23:52.952155 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-6cb25aee-a6f6-4b26-8086-2c8feb33505e req-9a68df45-dd0d-4626-b1a3-ea357a75744e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Deleting port a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:23:52.952400 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-6cb25aee-a6f6-4b26-8086-2c8feb33505e req-9a68df45-dd0d-4626-b1a3-ea357a75744e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:53.101006 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-6cb25aee-a6f6-4b26-8086-2c8feb33505e req-9a68df45-dd0d-4626-b1a3-ea357a75744e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] For port a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9,segment=NetworkSegment(016e9daa-b906-4ec8-978d-cb58fbcd78da),segment_id=016e9daa-b906-4ec8-978d-cb58fbcd78da)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:23:53.101749 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-6cb25aee-a6f6-4b26-8086-2c8feb33505e req-9a68df45-dd0d-4626-b1a3-ea357a75744e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:53.220940 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bd15e72-61de-49b1-8ce3-4bb373fb9001 req-220fbdb7-47ad-43c3-bf33-e07eff950364 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:53.228496 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2bd15e72-61de-49b1-8ce3-4bb373fb9001 req-220fbdb7-47ad-43c3-bf33-e07eff950364 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 945 time: 0.0925078
May 31 16:23:53.256082 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-6cb25aee-a6f6-4b26-8086-2c8feb33505e req-9a68df45-dd0d-4626-b1a3-ea357a75744e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Calling delete_port for a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 owned by compute:nova {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:23:53.290159 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2bd15e72-61de-49b1-8ce3-4bb373fb9001 req-361e4e86-014e-4cb3-a54c-b7972808b575 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0605526
May 31 16:23:53.400195 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-6cb25aee-a6f6-4b26-8086-2c8feb33505e req-9a68df45-dd0d-4626-b1a3-ea357a75744e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:53.405781 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-6301fd54-4719-4b13-9890-2b9dec06b9f6 tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:53.416767 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['5591c8db-5905-4285-84f7-5743de100fc2', 'a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:23:53.491564 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a68df45-dd0d-4626-b1a3-ea357a75744e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Pushing event deleted for resources: {'Port': ['ID=a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:53.494276 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-9a68df45-dd0d-4626-b1a3-ea357a75744e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:53.547441 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [req-6cb25aee-a6f6-4b26-8086-2c8feb33505e req-9a68df45-dd0d-4626-b1a3-ea357a75744e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] No DVR routers for this DVR port a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 on host hv-cinder-79381 {{(pid=91763) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:23:53.551213 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-6cb25aee-a6f6-4b26-8086-2c8feb33505e req-9a68df45-dd0d-4626-b1a3-ea357a75744e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:53.568961 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-6cb25aee-a6f6-4b26-8086-2c8feb33505e req-9a68df45-dd0d-4626-b1a3-ea357a75744e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.63 "DELETE /v2.0/ports/a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 HTTP/1.1" status: 204  len: 173 time: 0.7524700
May 31 16:23:53.571456 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 34266) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:23:53.966802 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc7f86eb-5832-4ac9-9180-e2e0c47ac143 req-1f0222e8-600b-43c7-8ab7-7bec65396371 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:53.968548 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-dc7f86eb-5832-4ac9-9180-e2e0c47ac143 req-1f0222e8-600b-43c7-8ab7-7bec65396371 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 947 time: 0.0958498
May 31 16:23:54.031090 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-dc7f86eb-5832-4ac9-9180-e2e0c47ac143 req-66790e92-9178-453a-bcb3-bcd9f71ba8c5 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0494349
May 31 16:23:54.280829 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6bd386ed-d4b5-4e83-8af1-ba4038c09593 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-16627919'] for router_interface, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:54.459929 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9f92adbe-ec5b-47a1-8845-bbdba70fda46 req-0c4b9880-6feb-4e66-8568-ba88f345d928 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=6030e04e-d246-465d-8374-4d11b6a0ecb7 HTTP/1.1" status: 200  len: 210 time: 0.0469735
May 31 16:23:54.616842 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6030e04e-d246-465d-8374-4d11b6a0ecb7', 'name': 'network-vif-deleted', 'tag': 'a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:23:54.619236 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-158c50c0-0d5b-4d17-917f-87032ec06a2d" -d '{"events": [{"server_uuid": "6030e04e-d246-465d-8374-4d11b6a0ecb7", "name": "network-vif-deleted", "tag": "a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:23:54.667842 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:23:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6c293dab-9b89-4557-8060-00f4ac22735a x-openstack-request-id: req-6c293dab-9b89-4557-8060-00f4ac22735a {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:23:54.668163 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6030e04e-d246-465d-8374-4d11b6a0ecb7", "name": "network-vif-deleted", "tag": "a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:23:54.668587 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-6c293dab-9b89-4557-8060-00f4ac22735a {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:23:54.668878 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6030e04e-d246-465d-8374-4d11b6a0ecb7', 'name': 'network-vif-deleted', 'tag': 'a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9', 'status': 'completed', 'code': 200}
May 31 16:23:54.835497 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-6bd386ed-d4b5-4e83-8af1-ba4038c09593 admin admin] Deleting port 13d2d45a-63a0-45f1-bfe6-b2f687e752e0 {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:23:54.835901 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6bd386ed-d4b5-4e83-8af1-ba4038c09593 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:54.970424 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [None req-6bd386ed-d4b5-4e83-8af1-ba4038c09593 admin admin] For port 13d2d45a-63a0-45f1-bfe6-b2f687e752e0, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=13d2d45a-63a0-45f1-bfe6-b2f687e752e0,segment=NetworkSegment(5a3941ae-d5de-4802-8fd8-3da6c1932b05),segment_id=5a3941ae-d5de-4802-8fd8-3da6c1932b05)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:23:54.970873 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6bd386ed-d4b5-4e83-8af1-ba4038c09593 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:55.110613 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-6bd386ed-d4b5-4e83-8af1-ba4038c09593 admin admin] Calling delete_port for 13d2d45a-63a0-45f1-bfe6-b2f687e752e0 owned by network:router_interface {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:23:55.244368 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69d6ccec-b828-474d-8ee0-ab7d93a1a27e req-e1d73936-11c7-4156-b537-bd1988d53d30 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:55.246197 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-69d6ccec-b828-474d-8ee0-ab7d93a1a27e req-e1d73936-11c7-4156-b537-bd1988d53d30 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 947 time: 0.0933759
May 31 16:23:55.294788 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-69d6ccec-b828-474d-8ee0-ab7d93a1a27e req-03f7c65e-7bf3-4baa-be97-7a2adbbe3e80 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0423789
May 31 16:23:55.414174 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6bd386ed-d4b5-4e83-8af1-ba4038c09593 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:55.417757 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d5858ec1-0917-4500-8601-0b492dce0e58 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:55.491629 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bd386ed-d4b5-4e83-8af1-ba4038c09593 admin admin] Pushing event deleted for resources: {'Port': ['ID=13d2d45a-63a0-45f1-bfe6-b2f687e752e0,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:55.498764 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-6bd386ed-d4b5-4e83-8af1-ba4038c09593 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:55.766023 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6bd386ed-d4b5-4e83-8af1-ba4038c09593 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-16317375', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-16625247'] for router_interface, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:56.263857 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6bd386ed-d4b5-4e83-8af1-ba4038c09593 admin admin] Router d7d26526-a6db-4e30-b1f1-233672c995e8 has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91763) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:23:56.472545 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6bd386ed-d4b5-4e83-8af1-ba4038c09593 admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:23:56.483128 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1931039c-2752-4fc5-ac26-3badda99e318 None None] Sync routers for ids ['d7d26526-a6db-4e30-b1f1-233672c995e8'] in dv-cinder-793814-1-iscsi {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:23:56.489841 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-6bd386ed-d4b5-4e83-8af1-ba4038c09593 admin admin] 10.222.0.43 "PUT /v2.0/routers/d7d26526-a6db-4e30-b1f1-233672c995e8/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.9163258
May 31 16:23:56.492392 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 34318) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:23:56.500666 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1931039c-2752-4fc5-ac26-3badda99e318 None None] Routers {'d7d26526-a6db-4e30-b1f1-233672c995e8'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:23:56.501306 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-1931039c-2752-4fc5-ac26-3badda99e318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426c667c0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:23:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['d7d26526-a6db-4e30-b1f1-233672c995e8'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:23:56.675382 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b9e31ea1-79eb-4f81-b325-dafe929ba765 admin admin] Notify callbacks [] for router, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:56.701219 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-1931039c-2752-4fc5-ac26-3badda99e318 None None] Set router d7d26526-a6db-4e30-b1f1-233672c995e8 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:23:56.703339 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device f99df66c-c850-4d01-80ae-3d312eee69db no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:23:56.749937 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] No Port match for: f99df66c-c850-4d01-80ae-3d312eee69db {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:23:56.750456 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device f99df66c-c850-4d01-80ae-3d312eee69db not bound to the agent host hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:23:56.751151 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:23:56.800271 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] No Port match for: a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:23:56.800928 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device a6ebe1a2-4533-44af-a1bf-5f2cd3b9c8a9 not bound to the agent host hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:23:56.865320 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b9e31ea1-79eb-4f81-b325-dafe929ba765 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:56.950768 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-b9e31ea1-79eb-4f81-b325-dafe929ba765 admin admin] Deleting port a2424563-d6d6-443a-a1ac-cb2782c1c228 {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:23:56.950993 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b9e31ea1-79eb-4f81-b325-dafe929ba765 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:57.027951 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-1931039c-2752-4fc5-ac26-3badda99e318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426c667c0>, [{'id': 'd7d26526-a6db-4e30-b1f1-233672c995e8', 'name': 'tempest-ServerRescueNegativeTestJSON-1748311148-router', 'tenant_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.92'}], 'enable_snat': True}, 'gw_port_id': 'a2424563-d6d6-443a-a1ac-cb2782c1c228', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:59Z', 'updated_at': '2021-05-31T16:23:55Z', 'revision_number': 5, 'project_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'gw_port': {'id': 'a2424563-d6d6-443a-a1ac-cb2782c1c228', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:fe:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd7d26526-a6db-4e30-b1f1-233672c995e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 82, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.92', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:01Z', 'updated_at': '2021-05-31T16:20:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:23:57.033000 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1931039c-2752-4fc5-ac26-3badda99e318 None None] Checking router: d7d26526-a6db-4e30-b1f1-233672c995e8 for host: dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:23:57.042822 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1931039c-2752-4fc5-ac26-3badda99e318 None None] Routers {'d7d26526-a6db-4e30-b1f1-233672c995e8'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:23:57.043459 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-1931039c-2752-4fc5-ac26-3badda99e318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426c667c0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:23:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['d7d26526-a6db-4e30-b1f1-233672c995e8'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:23:57.098340 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [None req-b9e31ea1-79eb-4f81-b325-dafe929ba765 admin admin] For port a2424563-d6d6-443a-a1ac-cb2782c1c228, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=a2424563-d6d6-443a-a1ac-cb2782c1c228,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:23:57.098849 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b9e31ea1-79eb-4f81-b325-dafe929ba765 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:57.230237 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-b9e31ea1-79eb-4f81-b325-dafe929ba765 admin admin] Calling delete_port for a2424563-d6d6-443a-a1ac-cb2782c1c228 owned by network:router_gateway {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:23:57.231282 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34db365a-6d09-4f13-b576-c4399125a331 req-71730d6e-628d-495e-8517-7f75e63397c7 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:57.234464 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-34db365a-6d09-4f13-b576-c4399125a331 req-71730d6e-628d-495e-8517-7f75e63397c7 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 945 time: 0.0878241
May 31 16:23:57.234632 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-1931039c-2752-4fc5-ac26-3badda99e318 None None] Set router d7d26526-a6db-4e30-b1f1-233672c995e8 gateway port host: None {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:23:57.280285 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-34db365a-6d09-4f13-b576-c4399125a331 req-1cf2a309-c958-46ae-a7fc-8f1cb99d6e35 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411978
May 31 16:23:57.344123 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-1931039c-2752-4fc5-ac26-3badda99e318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426c667c0>, [{'id': 'd7d26526-a6db-4e30-b1f1-233672c995e8', 'name': 'tempest-ServerRescueNegativeTestJSON-1748311148-router', 'tenant_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:59Z', 'updated_at': '2021-05-31T16:23:56Z', 'revision_number': 6, 'project_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'gw_port_host': None}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:23:57.348697 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1931039c-2752-4fc5-ac26-3badda99e318 None None] The sync data for ids ['d7d26526-a6db-4e30-b1f1-233672c995e8'] in dv-cinder-793814-1-iscsi is: [{'id': 'd7d26526-a6db-4e30-b1f1-233672c995e8', 'name': 'tempest-ServerRescueNegativeTestJSON-1748311148-router', 'tenant_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:59Z', 'updated_at': '2021-05-31T16:23:56Z', 'revision_number': 6, 'project_id': '1739d3c0e2734c8a9af5c5291aac8e25', 'gw_port_host': None}] {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:23:57.380853 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b9e31ea1-79eb-4f81-b325-dafe929ba765 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:57.384938 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:57.428951 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9e31ea1-79eb-4f81-b325-dafe929ba765 admin admin] Pushing event deleted for resources: {'Port': ['ID=a2424563-d6d6-443a-a1ac-cb2782c1c228,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:57.431878 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-b9e31ea1-79eb-4f81-b325-dafe929ba765 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:57.527938 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b9e31ea1-79eb-4f81-b325-dafe929ba765 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-16621778'] for router_gateway, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:57.798725 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b9e31ea1-79eb-4f81-b325-dafe929ba765 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-16623711', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-683'] for router, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:57.801610 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b9e31ea1-79eb-4f81-b325-dafe929ba765 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:57.890035 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b9e31ea1-79eb-4f81-b325-dafe929ba765 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-16623971'] for router, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:57.890589 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b9e31ea1-79eb-4f81-b325-dafe929ba765 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d7d26526-a6db-4e30-b1f1-233672c995e8 {{(pid=91763) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 31 16:23:57.904444 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-b9e31ea1-79eb-4f81-b325-dafe929ba765 admin admin] Notify callbacks [] for router, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:57.905606 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-b9e31ea1-79eb-4f81-b325-dafe929ba765 admin admin] 10.222.0.43 "DELETE /v2.0/routers/d7d26526-a6db-4e30-b1f1-233672c995e8 HTTP/1.1" status: 204  len: 168 time: 1.4122579
May 31 16:23:57.908166 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 34330) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:23:57.967809 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_v2 [None req-2a65a0ea-e2d0-4e69-b4f5-5d05fcad07fc admin admin] Deleting subnet b9c806fb-2a53-4445-8352-4336429eb043 {{(pid=91763) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 31 16:23:57.971443 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2a65a0ea-e2d0-4e69-b4f5-5d05fcad07fc admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:58.021720 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2a65a0ea-e2d0-4e69-b4f5-5d05fcad07fc admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-15104879'] for subnet, precommit_delete_associations {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:58.079868 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2a65a0ea-e2d0-4e69-b4f5-5d05fcad07fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-975336'] for subnet, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:58.238666 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device a2424563-d6d6-443a-a1ac-cb2782c1c228 no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:23:58.274259 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: a2424563-d6d6-443a-a1ac-cb2782c1c228 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:23:58.274615 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device a2424563-d6d6-443a-a1ac-cb2782c1c228 not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:23:58.275035 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 13d2d45a-63a0-45f1-bfe6-b2f687e752e0 no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:23:58.308922 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: 13d2d45a-63a0-45f1-bfe6-b2f687e752e0 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:23:58.309274 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 13d2d45a-63a0-45f1-bfe6-b2f687e752e0 not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:23:58.347698 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2a65a0ea-e2d0-4e69-b4f5-5d05fcad07fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-978269', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14336704', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-13992643'] for subnet, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:58.353065 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:58.394318 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a65a0ea-e2d0-4e69-b4f5-5d05fcad07fc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b9c806fb-2a53-4445-8352-4336429eb043,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:58.396354 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2a65a0ea-e2d0-4e69-b4f5-5d05fcad07fc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:58.405144 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-2a65a0ea-e2d0-4e69-b4f5-5d05fcad07fc admin admin] 10.222.0.43 "DELETE /v2.0/subnets/b9c806fb-2a53-4445-8352-4336429eb043 HTTP/1.1" status: 204  len: 168 time: 0.4929686
May 31 16:23:58.405144 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-2a65a0ea-e2d0-4e69-b4f5-5d05fcad07fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:58.405417 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 34336) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:23:58.483367 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c21ede7-b074-4a3f-993e-26cdc0a1abbd req-c92d1a12-3f41-4d5d-87f8-576dc536a370 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:58.484825 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1c21ede7-b074-4a3f-993e-26cdc0a1abbd req-c92d1a12-3f41-4d5d-87f8-576dc536a370 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 945 time: 0.0884113
May 31 16:23:58.514789 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9ab5b8bf-1fb6-4196-83a9-bd3cc1be2396 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-525980'] for network, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:58.532416 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1c21ede7-b074-4a3f-993e-26cdc0a1abbd req-edaec747-3046-43c0-8b80-b9ba8ca2e44f tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397747
May 31 16:23:58.639793 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9ab5b8bf-1fb6-4196-83a9-bd3cc1be2396 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-988775', 'neutron.services.segments.db._delete_segments_for_network-8732784586204'] for network, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:58.653272 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-9ab5b8bf-1fb6-4196-83a9-bd3cc1be2396 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f142579fbe0>,) {'filters': {'network_id': ['d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1']}} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:23:58.665880 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-9ab5b8bf-1fb6-4196-83a9-bd3cc1be2396 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f142579fbe0>, '5a3941ae-d5de-4802-8fd8-3da6c1932b05') {'for_net_delete': True} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:23:58.666180 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-9ab5b8bf-1fb6-4196-83a9-bd3cc1be2396 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f142579fbe0>, '5a3941ae-d5de-4802-8fd8-3da6c1932b05') {} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:23:58.677496 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9ab5b8bf-1fb6-4196-83a9-bd3cc1be2396 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732784599197', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15104868'] for segment, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:58.692891 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9ab5b8bf-1fb6-4196-83a9-bd3cc1be2396 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:58.698966 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9ab5b8bf-1fb6-4196-83a9-bd3cc1be2396 admin admin] Releasing vlan 824 on physical network physnet1 to pool {{(pid=91763) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 31 16:23:58.699405 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9ab5b8bf-1fb6-4196-83a9-bd3cc1be2396 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14337126'] for segment, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]: Traceback (most recent call last):
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:     timer()
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:     cb(*args, **kw)
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:     return func(*args, **kwargs)
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:     self._notify()
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:     self.callback(batched_events)
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:     event.method(event)
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:     aggregate_uuid = self.p_client.list_aggregates(
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:     return f(self, *a, **k)
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self._get(url).json()
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self.request(url, 'GET', **kwargs)
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:     base_url = self.get_endpoint(auth, allow=allow,
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 31 16:23:58.712826 dv-cinder-793814-1-iscsi neutron-server[91763]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 31 16:23:58.788429 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9ab5b8bf-1fb6-4196-83a9-bd3cc1be2396 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16621775'] for network, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:58.792646 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-323c16a6-8672-4fb9-8a29-ff085909a0bc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:58.808601 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9ab5b8bf-1fb6-4196-83a9-bd3cc1be2396 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:58.817050 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ab5b8bf-1fb6-4196-83a9-bd3cc1be2396 admin admin] Pushing event deleted for resources: {'Network': ['ID=d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:58.820153 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-9ab5b8bf-1fb6-4196-83a9-bd3cc1be2396 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:58.825574 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-9ab5b8bf-1fb6-4196-83a9-bd3cc1be2396 admin admin] 10.222.0.43 "DELETE /v2.0/networks/d89a2a7e-0a66-4cc2-94ab-1f50ba0056b1 HTTP/1.1" status: 204  len: 168 time: 0.4192042
May 31 16:23:59.001333 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 34346) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:23:59.052084 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-58f7873f-61fd-4552-a2d5-01e177246f3a admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=1739d3c0e2734c8a9af5c5291aac8e25&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0486927
May 31 16:23:59.054567 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 34350) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:23:59.115542 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-a00a8125-988c-483e-a868-5c22d188afb1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:59.141684 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-a00a8125-988c-483e-a868-5c22d188afb1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:59.199085 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-a00a8125-988c-483e-a868-5c22d188afb1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:59.202932 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-cf155fda-378a-47e6-8d71-f7faee6a2880 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:23:59.217214 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a00a8125-988c-483e-a868-5c22d188afb1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2ddff6af-58b8-4216-b12c-394bda88aeb3,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:23:59.219806 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-a00a8125-988c-483e-a868-5c22d188afb1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:23:59.229392 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-a00a8125-988c-483e-a868-5c22d188afb1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:23:59.230549 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-a00a8125-988c-483e-a868-5c22d188afb1 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/2ddff6af-58b8-4216-b12c-394bda88aeb3 HTTP/1.1" status: 204  len: 168 time: 0.1750870
May 31 16:23:59.737552 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55355bbf-ec83-43ce-af79-12dd5111b2c5 req-486ea750-f52e-4fbe-9e0f-e5609711a08c tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:23:59.739073 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-55355bbf-ec83-43ce-af79-12dd5111b2c5 req-486ea750-f52e-4fbe-9e0f-e5609711a08c tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 945 time: 0.0891342
May 31 16:23:59.787778 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-55355bbf-ec83-43ce-af79-12dd5111b2c5 req-1f0ec725-6780-4170-ab7a-8c9d1bbff107 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0430224
May 31 16:24:00.022478 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 34378) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:24:00.127852 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-783526721-network', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:24:00.132521 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:24:00.136326 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Usage tracker for resource:network and tenant:a56002dfed61485aa4d9e237932e1abf is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:24:00.139176 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:24:00.145394 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:24:00.155908 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Made reservation on behalf of a56002dfed61485aa4d9e237932e1abf for: {'network': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:24:00.159066 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-639279'] for network, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:00.171002 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:00.186292 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:24:00.190699 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Usage tracker for resource:security_group_rule and tenant:a56002dfed61485aa4d9e237932e1abf is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:24:00.193698 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:24:00.199505 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:24:00.292663 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:00.296559 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:00.300339 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-48524319-c07c-489c-98a5-f7510a623617 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:00.335620 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 833}  {{(pid=91763) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 31 16:24:00.341127 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=82558f49-83e7-4f32-9c14-4463c79b2f03,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:00.345094 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:00.351701 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:00.351906 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.segments_db [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Added segment 1974822a-78ff-4607-935a-c9f5ba4a898d of type vlan for network cd1ac218-ff8f-46e5-91e3-f1ff613f07d5
May 31 16:24:00.381922 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732784079930'] for network, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:00.415811 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366'] for network, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:00.417500 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:00.418086 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:00.421674 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d6e9c03c-506a-42c2-ba37-dab70d097d3d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:00.522329 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201  len: 883 time: 0.4987483
May 31 16:24:00.525247 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 34384) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:24:00.529792 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Pushing event updated for resources: {'Network': ['ID=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:00.531041 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-aa4da925-1a9b-4dcc-9736-87213d0d7a9c admin admin] Request body: {'subnet': {'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-783526721-subnet', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:24:00.532418 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:00.536133 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-aa4da925-1a9b-4dcc-9736-87213d0d7a9c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:24:00.539585 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Network cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 details requested by agent ovs-agent-dv-cinder-793814-1-iscsi with host dv-cinder-793814-1-iscsi {{(pid=91765) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 31 16:24:00.540192 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-aa4da925-1a9b-4dcc-9736-87213d0d7a9c admin admin] Usage tracker for resource:subnet and tenant:a56002dfed61485aa4d9e237932e1abf is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:24:00.543221 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-aa4da925-1a9b-4dcc-9736-87213d0d7a9c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:24:00.549051 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-aa4da925-1a9b-4dcc-9736-87213d0d7a9c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:24:00.563701 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa4da925-1a9b-4dcc-9736-87213d0d7a9c admin admin] Made reservation on behalf of a56002dfed61485aa4d9e237932e1abf for: {'subnet': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:24:00.566624 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-aa4da925-1a9b-4dcc-9736-87213d0d7a9c admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14793668'] for subnet, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:01.045916 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d21b340-7f81-4b1f-ba11-e3a2537339ca req-98a2132a-3a3f-4bc9-8f30-ce5a53a34233 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:01.047346 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9d21b340-7f81-4b1f-ba11-e3a2537339ca req-98a2132a-3a3f-4bc9-8f30-ce5a53a34233 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 945 time: 0.1162934
May 31 16:24:01.109980 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9d21b340-7f81-4b1f-ba11-e3a2537339ca req-8c47de4f-f91f-4b30-9bd2-087f07e35838 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0531344
May 31 16:24:01.164751 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-aa4da925-1a9b-4dcc-9736-87213d0d7a9c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-14907233', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14793682'] for subnet, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:01.168449 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-4bf0bd61-f5f6-4e90-8336-7fed7ff9a3e0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:01.243939 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa4da925-1a9b-4dcc-9736-87213d0d7a9c admin admin] Pushing event updated for resources: {'Subnet': ['ID=6489943b-1236-4d7c-80a7-58ef5aedf09d,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:01.247221 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-aa4da925-1a9b-4dcc-9736-87213d0d7a9c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:01.253846 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa4da925-1a9b-4dcc-9736-87213d0d7a9c admin admin] Checking segment: {'id': '1974822a-78ff-4607-935a-c9f5ba4a898d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:24:01.254194 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa4da925-1a9b-4dcc-9736-87213d0d7a9c admin admin] Network hostable DHCP agents. Network: cd1ac218-ff8f-46e5-91e3-f1ff613f07d5, hostable agents: ['5c9859e8-5965-4c86-8b2b-8fab235cbf66'], hosted agents: [] {{(pid=91764) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 31 16:24:01.270504 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa4da925-1a9b-4dcc-9736-87213d0d7a9c admin admin] Network cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 is scheduled to be hosted by DHCP agent 5c9859e8-5965-4c86-8b2b-8fab235cbf66 with binding_index 1 {{(pid=91764) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 31 16:24:01.279572 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-aa4da925-1a9b-4dcc-9736-87213d0d7a9c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793814-1-iscsi, cd1ac218-ff8f-46e5-91e3-f1ff613f07d5) {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:24:01.287800 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4c300e3-cff1-4de3-8034-7f8605c34942 None None] Network cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:24:01.291205 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa4da925-1a9b-4dcc-9736-87213d0d7a9c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:01.291761 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-aa4da925-1a9b-4dcc-9736-87213d0d7a9c admin admin] Notify callbacks [] for subnet, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:01.317970 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 34396) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:24:01.318527 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-aa4da925-1a9b-4dcc-9736-87213d0d7a9c admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 0.7915831
May 31 16:24:01.323661 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:24:01.328446 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:24:01.332494 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Usage tracker for resource:router and tenant:a56002dfed61485aa4d9e237932e1abf is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:24:01.335472 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:24:01.341748 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:24:01.354279 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-16623804', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-697'] for router, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:01.355355 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-16618684', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-16621667', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-16430734', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-672'] for router, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:01.371754 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:01.511925 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp87ca72be-1027-56d4-a8d3-ba9dae998815-cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'fixed_ips': [{'subnet_id': '6489943b-1236-4d7c-80a7-58ef5aedf09d'}]}} from dv-cinder-793814-1-iscsi. {{(pid=91765) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 31 16:24:01.512768 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:01.680928 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.db_base_plugin_common [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Allocated IP 172.20.0.2 (cd1ac218-ff8f-46e5-91e3-f1ff613f07d5/6489943b-1236-4d7c-80a7-58ef5aedf09d/3509d824-80ea-4504-9f8f-a0c27f442aeb) {{(pid=91765) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:24:01.740693 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16621638', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16623758', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-722'] for router, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:01.921154 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Notify callbacks [] for port, precommit_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:01.931809 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Transition to ACTIVE for port object 3509d824-80ea-4504-9f8f-a0c27f442aeb will not be triggered until provisioned by entity L2. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:24:01.950332 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Transition to ACTIVE for port object 3509d824-80ea-4504-9f8f-a0c27f442aeb will not be triggered until provisioned by entity DHCP. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:24:01.956279 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:01.959975 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-7fa7fa86-454f-4935-a12f-2476c6bbf261 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:02.031683 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Network cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 is already hosted by enough agents. {{(pid=91765) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:24:02.035412 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.scheduler.base_scheduler [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Resources bound (agent type, host, resource id):  {{(pid=91765) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:24:02.040046 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Received port after_create {{(pid=91765) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:24:02.042071 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Pushing event updated for resources: {'Port': ['ID=3509d824-80ea-4504-9f8f-a0c27f442aeb,revision_number=1']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:02.045572 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:02.087741 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:02.119852 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:02.132429 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Attempting to bind port 3509d824-80ea-4504-9f8f-a0c27f442aeb on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:24:02.132814 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Attempting to bind port 3509d824-80ea-4504-9f8f-a0c27f442aeb by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '1974822a-78ff-4607-935a-c9f5ba4a898d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5'}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:24:02.133188 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Attempting to bind port 3509d824-80ea-4504-9f8f-a0c27f442aeb on network cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:24:02.139456 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 23, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:24:02.139456 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Checking segment: {'id': '1974822a-78ff-4607-935a-c9f5ba4a898d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91765) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:24:02.139667 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:02.139981 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Bound using segment: {'id': '1974822a-78ff-4607-935a-c9f5ba4a898d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5'} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:24:02.140456 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Bound port: 3509d824-80ea-4504-9f8f-a0c27f442aeb, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1974822a-78ff-4607-935a-c9f5ba4a898d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5'}}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:24:02.140834 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:02.237328 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] For port 3509d824-80ea-4504-9f8f-a0c27f442aeb, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91765) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:24:02.241116 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] For port 3509d824-80ea-4504-9f8f-a0c27f442aeb, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=3509d824-80ea-4504-9f8f-a0c27f442aeb,segment=NetworkSegment(1974822a-78ff-4607-935a-c9f5ba4a898d),segment_id=1974822a-78ff-4607-935a-c9f5ba4a898d)] {{(pid=91765) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:24:02.247546 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:02.252641 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:02.278575 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Allocated IP 172.27.0.11 (00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c/96709d85-d0fe-4cf8-b232-eaf6b143ebe6/e6e58ebd-df49-45cc-b013-4b6d60b76a86) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:24:02.314624 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-218d3bf1-4173-402c-8456-d182d1e8fd02 req-89cfdd51-0eeb-4263-805f-e058aa74db4d tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:02.316366 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-218d3bf1-4173-402c-8456-d182d1e8fd02 req-89cfdd51-0eeb-4263-805f-e058aa74db4d tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 945 time: 0.0906074
May 31 16:24:02.334283 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Pushing event updated for resources: {'Port': ['ID=3509d824-80ea-4504-9f8f-a0c27f442aeb,revision_number=2']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:02.337700 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:02.368166 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-218d3bf1-4173-402c-8456-d182d1e8fd02 req-fa400dfd-c57b-4ab0-84af-23bdd70de581 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0431156
May 31 16:24:02.438150 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:02.468129 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:02.471934 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:02.556245 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Pushing event updated for resources: {'Port': ['ID=e6e58ebd-df49-45cc-b013-4b6d60b76a86,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:02.559781 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:24:02.560692 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:02.561718 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:24:02.564080 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:24:03.090461 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:03.259886 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a7678db4-0e36-4a21-8c48-5093b8445e06 None None] Network cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:24:03.411687 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-e21f186c-187c-45f5-bc18-ab010c465f4d None None] Provisioning for port 3509d824-80ea-4504-9f8f-a0c27f442aeb completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:24:03.442101 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-16623797', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16621573'] for router, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:03.573853 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83775f3c-093c-47ea-bcc5-15b7e7cb5b9e req-3c41243e-c6b9-4e7c-b52a-86bd99ae984b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:03.575365 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-83775f3c-093c-47ea-bcc5-15b7e7cb5b9e req-3c41243e-c6b9-4e7c-b52a-86bd99ae984b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 945 time: 0.0941799
May 31 16:24:03.624995 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-83775f3c-093c-47ea-bcc5-15b7e7cb5b9e req-47d9975e-bdc6-47ba-a967-72068d459ca1 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429151
May 31 16:24:03.682785 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Router 2bcd5afd-bdf4-472d-8a91-95997718441c is scheduled to L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e with binding_index 1 {{(pid=91763) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 31 16:24:03.865982 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:24:03.874723 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] Sync routers for ids ['2bcd5afd-bdf4-472d-8a91-95997718441c'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:24:03.884553 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] Routers {'2bcd5afd-bdf4-472d-8a91-95997718441c'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:24:03.885177 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f142639f070>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:23:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['2bcd5afd-bdf4-472d-8a91-95997718441c'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:24:03.889791 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Notify callbacks [] for router, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:03.894234 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201  len: 921 time: 2.5719113
May 31 16:24:03.894455 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 34408) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:24:04.096203 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] Set router 2bcd5afd-bdf4-472d-8a91-95997718441c gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:24:04.317890 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 3509d824-80ea-4504-9f8f-a0c27f442aeb up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:24:04.442747 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port 3509d824-80ea-4504-9f8f-a0c27f442aeb completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:24:04.450228 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 3509d824-80ea-4504-9f8f-a0c27f442aeb triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:24:04.450615 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:04.525897 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f142639f070>, [{'id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:24:01Z', 'updated_at': '2021-05-31T16:24:02Z', 'revision_number': 3, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'gw_port': {'id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:d3:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 468, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:02Z', 'updated_at': '2021-05-31T16:24:02Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:24:04.531846 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] Checking router: 2bcd5afd-bdf4-472d-8a91-95997718441c for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:24:04.532207 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] Updating router 2bcd5afd-bdf4-472d-8a91-95997718441c port e6e58ebd-df49-45cc-b013-4b6d60b76a86 binding host dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 31 16:24:04.635966 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:04.690874 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:04.764855 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:04.791989 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port 3509d824-80ea-4504-9f8f-a0c27f442aeb, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=3509d824-80ea-4504-9f8f-a0c27f442aeb,segment=NetworkSegment(1974822a-78ff-4607-935a-c9f5ba4a898d),segment_id=1974822a-78ff-4607-935a-c9f5ba4a898d)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:24:04.800951 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:04.805282 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:04.864072 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ac7bdd9-9de2-4653-b27e-7048aea806f5 req-2152ec95-570a-4291-a9bd-b9644d40c0ec tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:04.865949 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2ac7bdd9-9de2-4653-b27e-7048aea806f5 req-2152ec95-570a-4291-a9bd-b9644d40c0ec tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 945 time: 0.1272745
May 31 16:24:04.919072 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2ac7bdd9-9de2-4653-b27e-7048aea806f5 req-93173837-101f-4d08-8313-8178e85f175a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0439398
May 31 16:24:04.964946 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=3509d824-80ea-4504-9f8f-a0c27f442aeb,revision_number=3']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:04.969305 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:05.027963 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-903b0ec3-b047-4ff7-950e-953e8b0482ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:05.070244 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed05a660-500c-4b3b-b6d3-3e9063e7f369 req-36f538ea-9ca3-4566-8796-72fe1ebed46c tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:05.070955 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-ed05a660-500c-4b3b-b6d3-3e9063e7f369 req-36f538ea-9ca3-4566-8796-72fe1ebed46c tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Synchronizing usage tracker for tenant:0eb6e65b3f844417816fb1e5c88a8004 on resource:port {{(pid=91763) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:24:05.100958 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Allocated IP 172.20.0.1 (cd1ac218-ff8f-46e5-91e3-f1ff613f07d5/6489943b-1236-4d7c-80a7-58ef5aedf09d/729c3966-0f99-4a7d-ab46-eadab5d24529) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:24:05.107266 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-ed05a660-500c-4b3b-b6d3-3e9063e7f369 req-36f538ea-9ca3-4566-8796-72fe1ebed46c tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Unset dirty status for tenant:0eb6e65b3f844417816fb1e5c88a8004 on resource:port {{(pid=91763) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:24:05.108406 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-ed05a660-500c-4b3b-b6d3-3e9063e7f369 req-36f538ea-9ca3-4566-8796-72fe1ebed46c tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.63 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 945 time: 0.2374032
May 31 16:24:05.113032 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] Notify callbacks [] for port, precommit_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:05.126830 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] Transition to ACTIVE for port object e6e58ebd-df49-45cc-b013-4b6d60b76a86 will not be triggered until provisioned by entity L2. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:24:05.134970 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:05.138896 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:05.238683 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] Attempting to bind port e6e58ebd-df49-45cc-b013-4b6d60b76a86 on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:24:05.239084 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] Attempting to bind port e6e58ebd-df49-45cc-b013-4b6d60b76a86 by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:24:05.239453 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] Attempting to bind port e6e58ebd-df49-45cc-b013-4b6d60b76a86 on network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:24:05.257343 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97fafd75-a3e0-4389-b16f-a822f16d4fd0 None None] Pushing event updated for resources: {'Port': ['ID=e6e58ebd-df49-45cc-b013-4b6d60b76a86,revision_number=2']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:05.260845 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-97fafd75-a3e0-4389-b16f-a822f16d4fd0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:05.262303 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 23, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:24:05.263169 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] Checking segment: {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91765) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:24:05.263169 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:05.263541 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] Bound using segment: {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:24:05.263990 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] Bound port: e6e58ebd-df49-45cc-b013-4b6d60b76a86, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:24:05.264367 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:05.350728 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] For port e6e58ebd-df49-45cc-b013-4b6d60b76a86, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91765) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:24:05.355050 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] For port e6e58ebd-df49-45cc-b013-4b6d60b76a86, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=e6e58ebd-df49-45cc-b013-4b6d60b76a86,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91765) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:24:05.360171 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:05.370153 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:05.371387 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-97fafd75-a3e0-4389-b16f-a822f16d4fd0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:05.394149 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.provisioning_blocks [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Transition to ACTIVE for port object 729c3966-0f99-4a7d-ab46-eadab5d24529 will not be triggered until provisioned by entity DHCP. {{(pid=91763) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:24:05.405743 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-ed05a660-500c-4b3b-b6d3-3e9063e7f369 req-2f70d77f-9316-42f4-94a4-36f61c39776a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Deleting port 5591c8db-5905-4285-84f7-5743de100fc2 {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:24:05.406100 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-ed05a660-500c-4b3b-b6d3-3e9063e7f369 req-2f70d77f-9316-42f4-94a4-36f61c39776a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:05.447884 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97fafd75-a3e0-4389-b16f-a822f16d4fd0 None None] Pushing event updated for resources: {'Port': ['ID=e6e58ebd-df49-45cc-b013-4b6d60b76a86,revision_number=3']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:05.454503 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-97fafd75-a3e0-4389-b16f-a822f16d4fd0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:05.467541 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] Routers {'2bcd5afd-bdf4-472d-8a91-95997718441c'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:24:05.468214 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f142639f070>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:23:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['2bcd5afd-bdf4-472d-8a91-95997718441c'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:24:05.529767 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:05.536802 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:05.620404 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-ed05a660-500c-4b3b-b6d3-3e9063e7f369 req-2f70d77f-9316-42f4-94a4-36f61c39776a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] For port 5591c8db-5905-4285-84f7-5743de100fc2, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=5591c8db-5905-4285-84f7-5743de100fc2,segment=NetworkSegment(016e9daa-b906-4ec8-978d-cb58fbcd78da),segment_id=016e9daa-b906-4ec8-978d-cb58fbcd78da)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:24:05.620773 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-ed05a660-500c-4b3b-b6d3-3e9063e7f369 req-2f70d77f-9316-42f4-94a4-36f61c39776a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:05.634621 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Network cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:24:05.639700 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:24:05.645927 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:24:05.666562 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] Set router 2bcd5afd-bdf4-472d-8a91-95997718441c gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:24:05.801568 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-ed05a660-500c-4b3b-b6d3-3e9063e7f369 req-2f70d77f-9316-42f4-94a4-36f61c39776a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Calling delete_port for 5591c8db-5905-4285-84f7-5743de100fc2 owned by compute:nova {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:24:05.808145 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Pushing event updated for resources: {'Port': ['ID=729c3966-0f99-4a7d-ab46-eadab5d24529,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:05.819350 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.282s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:05.853665 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-16627828'] for router_interface, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:05.928951 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-cf6dc367-3e19-4aac-b3b9-a280f2c7e752 None None] Provisioning for port 729c3966-0f99-4a7d-ab46-eadab5d24529 completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:24:05.945432 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-cf6dc367-3e19-4aac-b3b9-a280f2c7e752 None None] Provisioning complete for port 729c3966-0f99-4a7d-ab46-eadab5d24529 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:24:05.945846 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-cf6dc367-3e19-4aac-b3b9-a280f2c7e752 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:06.065854 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-cf6dc367-3e19-4aac-b3b9-a280f2c7e752 None None] Port 729c3966-0f99-4a7d-ab46-eadab5d24529 cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:24:06.103019 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f142639f070>, [{'id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:24:01Z', 'updated_at': '2021-05-31T16:24:02Z', 'revision_number': 3, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'gw_port': {'id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:d3:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 468, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:02Z', 'updated_at': '2021-05-31T16:24:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:24:06.108103 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa00d4ab-6a50-4f30-98f0-de9ee6887ce9 None None] The sync data for ids ['2bcd5afd-bdf4-472d-8a91-95997718441c'] in dv-cinder-793814-1-iscsi is: [{'id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:24:01Z', 'updated_at': '2021-05-31T16:24:02Z', 'revision_number': 3, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'gw_port': {'id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:d3:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 468, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:02Z', 'updated_at': '2021-05-31T16:24:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:24:06.145735 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aef3f292-6ae4-4254-ba62-ed1220b0de0b req-82f50bbb-1cba-4ff2-b49f-310ad9451e35 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:06.147370 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-aef3f292-6ae4-4254-ba62-ed1220b0de0b req-82f50bbb-1cba-4ff2-b49f-310ad9451e35 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 945 time: 0.1073995
May 31 16:24:06.187205 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-ed05a660-500c-4b3b-b6d3-3e9063e7f369 req-2f70d77f-9316-42f4-94a4-36f61c39776a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:06.194742 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-5fffdeb0-c64b-4465-ad5e-2103ff73aae1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:06.199281 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-aef3f292-6ae4-4254-ba62-ed1220b0de0b req-cd8fe203-41fc-4f2e-99c3-66a5843a9401 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/security-groups?id=860b379b-4832-4cf9-9ec8-1baa2d76c182&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0450737
May 31 16:24:06.248060 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f70d77f-9316-42f4-94a4-36f61c39776a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Pushing event deleted for resources: {'Port': ['ID=5591c8db-5905-4285-84f7-5743de100fc2,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:06.277669 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 3509d824-80ea-4504-9f8f-a0c27f442aeb up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:24:06.388012 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 3509d824-80ea-4504-9f8f-a0c27f442aeb triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:24:06.388639 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:06.409057 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-2f70d77f-9316-42f4-94a4-36f61c39776a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.214s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:06.409668 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:06.496510 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [req-ed05a660-500c-4b3b-b6d3-3e9063e7f369 req-2f70d77f-9316-42f4-94a4-36f61c39776a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] No DVR routers for this DVR port 5591c8db-5905-4285-84f7-5743de100fc2 on host hv-cinder-79381 {{(pid=91763) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:24:06.505259 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-ed05a660-500c-4b3b-b6d3-3e9063e7f369 req-2f70d77f-9316-42f4-94a4-36f61c39776a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:06.508052 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f08a2463-b6e4-494f-8f48-be855ffd203b', 'name': 'network-vif-deleted', 'tag': '5591c8db-5905-4285-84f7-5743de100fc2'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:24:06.510397 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-52908c9e-6713-4ff3-ac89-93d26c2150f2" -d '{"events": [{"server_uuid": "f08a2463-b6e4-494f-8f48-be855ffd203b", "name": "network-vif-deleted", "tag": "5591c8db-5905-4285-84f7-5743de100fc2"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:24:06.547263 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-ed05a660-500c-4b3b-b6d3-3e9063e7f369 req-2f70d77f-9316-42f4-94a4-36f61c39776a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.63 "DELETE /v2.0/ports/5591c8db-5905-4285-84f7-5743de100fc2 HTTP/1.1" status: 204  len: 173 time: 1.4185328
May 31 16:24:06.588727 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:24:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d9a228a6-bf4d-40b0-8af8-9fab2cb76f36 x-openstack-request-id: req-d9a228a6-bf4d-40b0-8af8-9fab2cb76f36 {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:24:06.589062 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f08a2463-b6e4-494f-8f48-be855ffd203b", "name": "network-vif-deleted", "tag": "5591c8db-5905-4285-84f7-5743de100fc2", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:24:06.589345 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-d9a228a6-bf4d-40b0-8af8-9fab2cb76f36 {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:24:06.589794 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f08a2463-b6e4-494f-8f48-be855ffd203b', 'name': 'network-vif-deleted', 'tag': '5591c8db-5905-4285-84f7-5743de100fc2', 'status': 'completed', 'code': 200}
May 31 16:24:06.723916 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:06.729764 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14337082'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:06.765785 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:06.846712 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-16310860', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-16627929'] for router_interface, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:06.850383 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Pushing event updated for resources: {'Port': ['ID=729c3966-0f99-4a7d-ab46-eadab5d24529,revision_number=2']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:06.853863 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:06.934062 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe1204b7-3da8-4cda-8d0f-b393197e1dde req-395fdb37-8011-49d3-9edd-c40579029306 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:06.935580 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-fe1204b7-3da8-4cda-8d0f-b393197e1dde req-395fdb37-8011-49d3-9edd-c40579029306 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 984 time: 0.0910320
May 31 16:24:06.992186 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Network cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:24:06.993294 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:24:06.993543 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-fe1204b7-3da8-4cda-8d0f-b393197e1dde req-7c5a848d-7806-49e2-ab78-cde0e8ae31f2 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78&id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0506999
May 31 16:24:07.195246 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-68f5ed48-b1f7-4e9e-a40c-73b01cdbeccd None None] Provisioning complete for port 729c3966-0f99-4a7d-ab46-eadab5d24529 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:24:07.195745 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-68f5ed48-b1f7-4e9e-a40c-73b01cdbeccd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:07.206274 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Router 2bcd5afd-bdf4-472d-8a91-95997718441c has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91763) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:24:07.254850 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-68f5ed48-b1f7-4e9e-a40c-73b01cdbeccd None None] Port 729c3966-0f99-4a7d-ab46-eadab5d24529 cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:24:07.360293 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3096a84d-08c1-4763-b6bd-d5fd0dd5480e req-b3e4c755-24e4-40f3-896d-1e8a5f6b03c5 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 210 time: 0.0442767
May 31 16:24:07.393250 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:24:07.398539 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] 10.222.0.43 "PUT /v2.0/routers/2bcd5afd-bdf4-472d-8a91-95997718441c/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.5031824
May 31 16:24:07.802038 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] Sync routers for ids ['2bcd5afd-bdf4-472d-8a91-95997718441c'] in dv-cinder-793814-1-iscsi {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:24:07.811737 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] Routers {'2bcd5afd-bdf4-472d-8a91-95997718441c'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:24:07.812380 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426e04e50>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:23:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['2bcd5afd-bdf4-472d-8a91-95997718441c'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:24:07.886683 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:07.992522 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] Set router 2bcd5afd-bdf4-472d-8a91-95997718441c gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:24:08.226622 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb1d2ea8-f5ea-4bc8-bc0c-0336d6b75509 req-8027f8a1-7fa7-456b-a044-d3728c79fe96 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:08.229419 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-eb1d2ea8-f5ea-4bc8-bc0c-0336d6b75509 req-8027f8a1-7fa7-456b-a044-d3728c79fe96 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 984 time: 0.1168070
May 31 16:24:08.235239 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-3311d904-8865-428a-8d9e-4a6ce5f56a37 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:08.314500 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-eb1d2ea8-f5ea-4bc8-bc0c-0336d6b75509 req-a13854b5-03aa-40f8-91a6-814f7e3a33c4 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78&id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0787878
May 31 16:24:08.343004 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device e6e58ebd-df49-45cc-b013-4b6d60b76a86 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:24:08.368993 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426e04e50>, [{'id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:24:01Z', 'updated_at': '2021-05-31T16:24:06Z', 'revision_number': 4, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'gw_port': {'id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:d3:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 468, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:02Z', 'updated_at': '2021-05-31T16:24:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '729c3966-0f99-4a7d-ab46-eadab5d24529', 'name': '', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'mac_address': 'fa:16:3e:23:3b:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_interface', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:04Z', 'updated_at': '2021-05-31T16:24:06Z', 'revision_number': 2, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'subnets': [{'id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:24:08.374364 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] Checking router: 2bcd5afd-bdf4-472d-8a91-95997718441c for host: dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:24:08.374718 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] Updating router 2bcd5afd-bdf4-472d-8a91-95997718441c port 729c3966-0f99-4a7d-ab46-eadab5d24529 binding host dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 31 16:24:08.405900 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 34450) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:24:08.412273 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Request body: {'security_group': {'name': 'tempest-securitygroup--943375963', 'description': 'tempest-description--1550224267'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:24:08.419633 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port e6e58ebd-df49-45cc-b013-4b6d60b76a86 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:24:08.420243 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:24:08.425094 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Usage tracker for resource:security_group and tenant:a56002dfed61485aa4d9e237932e1abf is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:24:08.427763 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port e6e58ebd-df49-45cc-b013-4b6d60b76a86 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:24:08.428148 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:08.429775 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:24:08.436814 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:24:08.439674 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:08.451462 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:08.511972 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:24:08.524387 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Usage tracker for resource:security_group_rule and tenant:a56002dfed61485aa4d9e237932e1abf is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:24:08.528774 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-813c4d37-93c2-433e-afbb-3bb9578c68e5 req-82dfc61c-8304-4e53-826b-c265634dbcc6 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] 10.222.0.43 "GET /v2.0/ports?device_id=f08a2463-b6e4-494f-8f48-be855ffd203b HTTP/1.1" status: 200  len: 210 time: 0.0499518
May 31 16:24:08.529681 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:24:08.536316 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:24:08.557574 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:08.576865 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port e6e58ebd-df49-45cc-b013-4b6d60b76a86, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=e6e58ebd-df49-45cc-b013-4b6d60b76a86,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:24:08.586141 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:08.588049 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-f4c3c3b5-7120-44f3-b718-a6e3e4355184 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:08.630441 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:08.634964 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:08.640346 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-b24f1b94-6b50-4b61-9488-fc7809569b5f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:08.663857 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=e6e58ebd-df49-45cc-b013-4b6d60b76a86,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:08.667005 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:08.681852 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:08.684200 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:08.685382 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 0.2784340
May 31 16:24:08.688587 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 34456) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:24:08.692362 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:08.692737 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:08.693109 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:08.693472 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:08.693880 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:08.694015 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-71eb6009-52a5-47cf-b18a-06ffc8c754ff tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Request body: {'security_group_rule': {'security_group_id': '3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:24:08.694242 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:08.694600 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:08.694957 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:08.695314 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:08.695665 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:08.696136 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:08.696493 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:08.700266 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:08.706254 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-71eb6009-52a5-47cf-b18a-06ffc8c754ff tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:24:08.712943 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-71eb6009-52a5-47cf-b18a-06ffc8c754ff tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Usage tracker for resource:security_group_rule and tenant:a56002dfed61485aa4d9e237932e1abf is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:24:08.715869 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-71eb6009-52a5-47cf-b18a-06ffc8c754ff tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:24:08.722166 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-71eb6009-52a5-47cf-b18a-06ffc8c754ff tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:24:08.738217 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-71eb6009-52a5-47cf-b18a-06ffc8c754ff tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:08.770807 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['5591c8db-5905-4285-84f7-5743de100fc2'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:24:08.819195 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] Notify callbacks [] for port, precommit_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:08.831544 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-71eb6009-52a5-47cf-b18a-06ffc8c754ff tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:08.832507 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.provisioning_blocks [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] Transition to ACTIVE for port object 729c3966-0f99-4a7d-ab46-eadab5d24529 will not be triggered until provisioned by entity L2. {{(pid=91766) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:24:08.837827 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-71eb6009-52a5-47cf-b18a-06ffc8c754ff tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:08.840038 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:08.840361 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-122fe52c-e2c8-410d-8c65-9170864e2071 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:08.844095 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:08.864920 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71eb6009-52a5-47cf-b18a-06ffc8c754ff tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ceb8aa4f-1362-45ff-89c4-cd6e64ef9a9f,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:08.871142 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-71eb6009-52a5-47cf-b18a-06ffc8c754ff tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:08.881501 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-71eb6009-52a5-47cf-b18a-06ffc8c754ff tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:08.885905 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-71eb6009-52a5-47cf-b18a-06ffc8c754ff tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1961293
May 31 16:24:08.886070 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 34460) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:24:08.891806 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-c565c56b-5d53-4438-9b1b-ba50009f6f85 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Request body: {'security_group_rule': {'security_group_id': '3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:24:08.907469 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-c565c56b-5d53-4438-9b1b-ba50009f6f85 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:24:08.912796 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-c565c56b-5d53-4438-9b1b-ba50009f6f85 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Usage tracker for resource:security_group_rule and tenant:a56002dfed61485aa4d9e237932e1abf is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:24:08.914782 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0c6cb54-aea4-43d9-9d44-7f494bd82290 None None] Pushing event updated for resources: {'Port': ['ID=729c3966-0f99-4a7d-ab46-eadab5d24529,revision_number=3']} {{(pid=91766) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:08.916866 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-c565c56b-5d53-4438-9b1b-ba50009f6f85 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:24:08.936772 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-c565c56b-5d53-4438-9b1b-ba50009f6f85 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:24:08.963518 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c565c56b-5d53-4438-9b1b-ba50009f6f85 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:09.002665 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f55a628e-52e8-4dd9-9c91-ac649682a38f req-f5d592f5-80bc-4ca4-83ca-cbfac68e298a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:09.003502 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-f55a628e-52e8-4dd9-9c91-ac649682a38f req-f5d592f5-80bc-4ca4-83ca-cbfac68e298a service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=8e66b29e29094a429643e0308704753b&device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 1137 time: 0.1150019
May 31 16:24:09.049352 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c565c56b-5d53-4438-9b1b-ba50009f6f85 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:09.056846 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c565c56b-5d53-4438-9b1b-ba50009f6f85 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:09.059831 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:09.090001 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c565c56b-5d53-4438-9b1b-ba50009f6f85 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=eb660501-3810-4d28-9164-f780edf63549,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:09.092466 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0c6cb54-aea4-43d9-9d44-7f494bd82290 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:09.092777 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0c6cb54-aea4-43d9-9d44-7f494bd82290 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:09.092886 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c565c56b-5d53-4438-9b1b-ba50009f6f85 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:09.093154 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0c6cb54-aea4-43d9-9d44-7f494bd82290 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:09.093485 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0c6cb54-aea4-43d9-9d44-7f494bd82290 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:09.093876 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0c6cb54-aea4-43d9-9d44-7f494bd82290 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:09.094565 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0c6cb54-aea4-43d9-9d44-7f494bd82290 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:09.094951 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0c6cb54-aea4-43d9-9d44-7f494bd82290 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:09.095615 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0c6cb54-aea4-43d9-9d44-7f494bd82290 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:09.096005 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0c6cb54-aea4-43d9-9d44-7f494bd82290 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:09.096402 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0c6cb54-aea4-43d9-9d44-7f494bd82290 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:09.096971 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0c6cb54-aea4-43d9-9d44-7f494bd82290 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:09.097097 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0c6cb54-aea4-43d9-9d44-7f494bd82290 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:09.101746 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-e0c6cb54-aea4-43d9-9d44-7f494bd82290 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.257s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:09.102841 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c565c56b-5d53-4438-9b1b-ba50009f6f85 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:09.104440 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-c565c56b-5d53-4438-9b1b-ba50009f6f85 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.2170794
May 31 16:24:09.108534 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 34464) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:24:09.115947 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Request body: {'floatingip': {'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:24:09.124232 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:24:09.136403 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Usage tracker for resource:floatingip and tenant:a56002dfed61485aa4d9e237932e1abf is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:24:09.145958 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:24:09.157148 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:24:09.161294 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:09.176887 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for floatingip, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:09.177570 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] Attempting to bind port 729c3966-0f99-4a7d-ab46-eadab5d24529 on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:24:09.178087 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] Attempting to bind port 729c3966-0f99-4a7d-ab46-eadab5d24529 by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '1974822a-78ff-4607-935a-c9f5ba4a898d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5'}] {{(pid=91766) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:24:09.178565 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] Attempting to bind port 729c3966-0f99-4a7d-ab46-eadab5d24529 on network cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:24:09.186986 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 24, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:24:09.187727 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] Checking segment: {'id': '1974822a-78ff-4607-935a-c9f5ba4a898d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91766) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:24:09.187861 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:09.188343 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] Bound using segment: {'id': '1974822a-78ff-4607-935a-c9f5ba4a898d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5'} {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:24:09.189041 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] Bound port: 729c3966-0f99-4a7d-ab46-eadab5d24529, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1974822a-78ff-4607-935a-c9f5ba4a898d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5'}}] {{(pid=91766) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:24:09.189639 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:09.192203 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f55a628e-52e8-4dd9-9c91-ac649682a38f req-e0772c77-ae96-4b29-9cd4-576a919b4c99 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:09.193685 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-f55a628e-52e8-4dd9-9c91-ac649682a38f req-e0772c77-ae96-4b29-9cd4-576a919b4c99 service neutron] 10.222.0.63 "GET /v2.0/networks?id=e3df5118-0a40-4a66-b31c-a978a0c899cf HTTP/1.1" status: 200  len: 915 time: 0.1816814
May 31 16:24:09.308911 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.db [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] For port 729c3966-0f99-4a7d-ab46-eadab5d24529, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91766) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:24:09.313284 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.db [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] For port 729c3966-0f99-4a7d-ab46-eadab5d24529, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=729c3966-0f99-4a7d-ab46-eadab5d24529,segment=NetworkSegment(1974822a-78ff-4607-935a-c9f5ba4a898d),segment_id=1974822a-78ff-4607-935a-c9f5ba4a898d)] {{(pid=91766) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:24:09.323825 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:09.334764 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-68eb08f8-b7c3-481a-9f97-d85820486f58 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:09.351322 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-f55a628e-52e8-4dd9-9c91-ac649682a38f req-efcbb498-cd3e-461d-9688-359ba572d357 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=747cd83a-69bc-48d9-8ba9-e9638b7be825 HTTP/1.1" status: 200  len: 1001 time: 0.1474257
May 31 16:24:09.369900 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:09.420488 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] Routers {'2bcd5afd-bdf4-472d-8a91-95997718441c'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:24:09.425386 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426e04e50>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:24:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['2bcd5afd-bdf4-472d-8a91-95997718441c'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:24:09.438924 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f55a628e-52e8-4dd9-9c91-ac649682a38f req-aefc4888-8b4d-4036-99e6-824df34fc23e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:09.441818 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-f55a628e-52e8-4dd9-9c91-ac649682a38f req-aefc4888-8b4d-4036-99e6-824df34fc23e service neutron] 10.222.0.63 "GET /v2.0/subnets?id=1a675b0f-478f-47e0-acdd-51bacffe39b6 HTTP/1.1" status: 200  len: 853 time: 0.0784535
May 31 16:24:09.498540 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0c6cb54-aea4-43d9-9d44-7f494bd82290 None None] Pushing event updated for resources: {'Port': ['ID=729c3966-0f99-4a7d-ab46-eadab5d24529,revision_number=4']} {{(pid=91766) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:09.509133 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-e0c6cb54-aea4-43d9-9d44-7f494bd82290 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:09.558351 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f55a628e-52e8-4dd9-9c91-ac649682a38f req-3f6e5d23-1f81-48c9-a16e-f256308eb7f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:09.560044 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-f55a628e-52e8-4dd9-9c91-ac649682a38f req-3f6e5d23-1f81-48c9-a16e-f256308eb7f1 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=e3df5118-0a40-4a66-b31c-a978a0c899cf&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1059644
May 31 16:24:09.703936 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] Set router 2bcd5afd-bdf4-472d-8a91-95997718441c gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:24:09.730019 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 34476) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:24:09.912070 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-f55a628e-52e8-4dd9-9c91-ac649682a38f req-4c3900e5-a265-4782-8135-824e39329739 service neutron] 10.222.0.63 "GET /v2.0/networks/e3df5118-0a40-4a66-b31c-a978a0c899cf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3362503
May 31 16:24:09.958766 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Allocated IP 172.27.0.98 (00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c/96709d85-d0fe-4cf8-b232-eaf6b143ebe6/82e8c89f-9311-4610-84a6-115ba250f936) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:24:09.963169 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_v2 [None req-6f0714ca-324d-4c0a-a433-4cd86966d017 admin admin] Deleting subnet 68c4d303-4299-4977-888e-57c80b8530cc {{(pid=91764) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 31 16:24:09.972450 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-195bead8-672a-49f0-a8c0-c70caafed5aa req-1b19407a-b0a7-4594-a005-2426d7a22e7d tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:09.974042 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-195bead8-672a-49f0-a8c0-c70caafed5aa req-1b19407a-b0a7-4594-a005-2426d7a22e7d tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 984 time: 0.4778712
May 31 16:24:09.978950 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-6f0714ca-324d-4c0a-a433-4cd86966d017 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:10.072972 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426e04e50>, [{'id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:24:01Z', 'updated_at': '2021-05-31T16:24:06Z', 'revision_number': 4, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'gw_port': {'id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:d3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 468, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:02Z', 'updated_at': '2021-05-31T16:24:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '729c3966-0f99-4a7d-ab46-eadab5d24529', 'name': '', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'mac_address': 'fa:16:3e:23:3b:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_interface', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:04Z', 'updated_at': '2021-05-31T16:24:09Z', 'revision_number': 4, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'subnets': [{'id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:24:10.078832 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68f22b8c-81cb-43aa-9d24-13d6c6c83b65 None None] The sync data for ids ['2bcd5afd-bdf4-472d-8a91-95997718441c'] in dv-cinder-793814-1-iscsi is: [{'id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:24:01Z', 'updated_at': '2021-05-31T16:24:06Z', 'revision_number': 4, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'gw_port': {'id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:d3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 468, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:02Z', 'updated_at': '2021-05-31T16:24:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '729c3966-0f99-4a7d-ab46-eadab5d24529', 'name': '', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'mac_address': 'fa:16:3e:23:3b:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_interface', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:04Z', 'updated_at': '2021-05-31T16:24:09Z', 'revision_number': 4, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'subnets': [{'id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:24:10.094183 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-f55a628e-52e8-4dd9-9c91-ac649682a38f req-2b35b9c6-3a10-44f9-9b72-43d427e5970d service neutron] 10.222.0.63 "GET /v2.0/networks/e3df5118-0a40-4a66-b31c-a978a0c899cf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1663892
May 31 16:24:10.105925 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-6f0714ca-324d-4c0a-a433-4cd86966d017 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14907384'] for subnet, precommit_delete_associations {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:10.226703 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-195bead8-672a-49f0-a8c0-c70caafed5aa req-0a05c164-c715-4b71-b027-05b528e67de1 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78&id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.2057149
May 31 16:24:10.271829 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-6f0714ca-324d-4c0a-a433-4cd86966d017 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-975336'] for subnet, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:10.363711 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:10.453658 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device e6e58ebd-df49-45cc-b013-4b6d60b76a86 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:24:10.541661 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:10.543496 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port e6e58ebd-df49-45cc-b013-4b6d60b76a86 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:24:10.543950 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:10.577598 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-eee3f746-dd3a-4865-be1e-a0b02a1fa044 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:10.667475 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:24:10.675122 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:24:10.678896 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Pushing event updated for resources: {'Port': ['ID=82e8c89f-9311-4610-84a6-115ba250f936,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:10.681360 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:24:10.690514 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 729c3966-0f99-4a7d-ab46-eadab5d24529 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:24:10.714860 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:10.758235 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-6f0714ca-324d-4c0a-a433-4cd86966d017 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-978269', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14907170', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14793691'] for subnet, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:10.766308 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:10.766510 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 5591c8db-5905-4285-84f7-5743de100fc2 no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:24:10.807467 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] No Port match for: 5591c8db-5905-4285-84f7-5743de100fc2 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:24:10.808360 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 5591c8db-5905-4285-84f7-5743de100fc2 not bound to the agent host hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:24:10.810138 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port 729c3966-0f99-4a7d-ab46-eadab5d24529 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:24:10.816137 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 729c3966-0f99-4a7d-ab46-eadab5d24529 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:24:10.816521 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:10.817768 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f0714ca-324d-4c0a-a433-4cd86966d017 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=68c4d303-4299-4977-888e-57c80b8530cc,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:10.821022 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-6f0714ca-324d-4c0a-a433-4cd86966d017 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:10.825594 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-6f0714ca-324d-4c0a-a433-4cd86966d017 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:10.839604 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-6f0714ca-324d-4c0a-a433-4cd86966d017 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/68c4d303-4299-4977-888e-57c80b8530cc HTTP/1.1" status: 204  len: 168 time: 1.1083829
May 31 16:24:10.840966 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:10.842208 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 34482) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:24:10.887094 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:10.972765 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:11.021225 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port 729c3966-0f99-4a7d-ab46-eadab5d24529, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=729c3966-0f99-4a7d-ab46-eadab5d24529,segment=NetworkSegment(1974822a-78ff-4607-935a-c9f5ba4a898d),segment_id=1974822a-78ff-4607-935a-c9f5ba4a898d)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:24:11.028460 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:11.031908 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:11.036210 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:11.109778 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=729c3966-0f99-4a7d-ab46-eadab5d24529,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:11.117239 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:11.133613 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f7b2c5b1-79d8-41d4-ae92-ab5aa6a16359 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-525980'] for network, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:11.366801 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f7b2c5b1-79d8-41d4-ae92-ab5aa6a16359 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-988775', 'neutron.services.segments.db._delete_segments_for_network-8732784586204'] for network, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:11.383872 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-f7b2c5b1-79d8-41d4-ae92-ab5aa6a16359 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f14250c7af0>,) {'filters': {'network_id': ['1097eeec-06a4-406d-ab4a-02e0123072d2']}} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:24:11.431270 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-f7b2c5b1-79d8-41d4-ae92-ab5aa6a16359 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f14250c7af0>, '016e9daa-b906-4ec8-978d-cb58fbcd78da') {'for_net_delete': True} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:24:11.431568 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-f7b2c5b1-79d8-41d4-ae92-ab5aa6a16359 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f14250c7af0>, '016e9daa-b906-4ec8-978d-cb58fbcd78da') {} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:24:11.462063 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f7b2c5b1-79d8-41d4-ae92-ab5aa6a16359 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732784599197', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14907379'] for segment, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:11.481256 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for port, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:11.492596 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:11.498891 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-b8f5cda6-4c16-48df-832e-8ef6ec58709d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:11.531664 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f7b2c5b1-79d8-41d4-ae92-ab5aa6a16359 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:11.550351 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f7b2c5b1-79d8-41d4-ae92-ab5aa6a16359 admin admin] Releasing vlan 838 on physical network physnet1 to pool {{(pid=91764) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 31 16:24:11.550899 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f7b2c5b1-79d8-41d4-ae92-ab5aa6a16359 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14905732'] for segment, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]: Traceback (most recent call last):
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:     timer()
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:     cb(*args, **kw)
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:     return func(*args, **kwargs)
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:     self._notify()
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:     self.callback(batched_events)
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:     event.method(event)
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:     aggregate_uuid = self.p_client.list_aggregates(
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:     return f(self, *a, **k)
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self._get(url).json()
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self.request(url, 'GET', **kwargs)
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:     base_url = self.get_endpoint(auth, allow=allow,
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 31 16:24:11.571921 dv-cinder-793814-1-iscsi neutron-server[91764]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 31 16:24:11.825223 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Pushing event updated for resources: {'Port': ['ID=82e8c89f-9311-4610-84a6-115ba250f936,revision_number=2']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:11.827556 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f7b2c5b1-79d8-41d4-ae92-ab5aa6a16359 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16621775'] for network, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:11.833798 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.334s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:11.835753 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16621821'] for floatingip, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:11.850141 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-be65b937-379b-4158-909b-98e3c39d535a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:11.874570 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f79e41f-62b7-4012-8e0c-d2999eb56763 req-f9f237a4-de60-4822-bf6f-e8077734dd64 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:11.876185 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0f79e41f-62b7-4012-8e0c-d2999eb56763 req-f9f237a4-de60-4822-bf6f-e8077734dd64 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 984 time: 0.4845796
May 31 16:24:11.877897 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f7b2c5b1-79d8-41d4-ae92-ab5aa6a16359 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:11.896410 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7b2c5b1-79d8-41d4-ae92-ab5aa6a16359 admin admin] Pushing event deleted for resources: {'Network': ['ID=1097eeec-06a4-406d-ab4a-02e0123072d2,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:11.912117 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for floatingip, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:11.913286 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 2.8039641
May 31 16:24:11.915998 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-f7b2c5b1-79d8-41d4-ae92-ab5aa6a16359 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:11.921986 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-f7b2c5b1-79d8-41d4-ae92-ab5aa6a16359 admin admin] 10.222.0.43 "DELETE /v2.0/networks/1097eeec-06a4-406d-ab4a-02e0123072d2 HTTP/1.1" status: 204  len: 168 time: 1.0784357
May 31 16:24:11.951021 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0f79e41f-62b7-4012-8e0c-d2999eb56763 req-13652e79-43a6-4128-a6d3-f4c090b13a84 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78&id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0601423
May 31 16:24:12.100272 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 34510) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:24:12.129174 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-217f3527-5786-4d73-8dca-5e691fb423c7 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Synchronizing usage tracker for tenant:a56002dfed61485aa4d9e237932e1abf on resource:security_group {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:24:12.153953 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-217f3527-5786-4d73-8dca-5e691fb423c7 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Unset dirty status for tenant:a56002dfed61485aa4d9e237932e1abf on resource:security_group {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:24:12.155304 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-217f3527-5786-4d73-8dca-5e691fb423c7 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-securitygroup--943375963&fields=id&tenant_id=a56002dfed61485aa4d9e237932e1abf HTTP/1.1" status: 200  len: 267 time: 0.0864968
May 31 16:24:12.157615 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-fa5d9d66-140b-45fc-b529-a4bae16dd613 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=0eb6e65b3f844417816fb1e5c88a8004&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0553176
May 31 16:24:12.161341 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 34516) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:24:12.289144 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8a579b0e-94b7-4d27-958b-f2ab6ea417c9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:12.298068 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 729c3966-0f99-4a7d-ab46-eadab5d24529 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:24:12.335944 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8a579b0e-94b7-4d27-958b-f2ab6ea417c9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:12.368963 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-ad266b62-d8a1-4eae-9ac7-5036e0511e4d tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:12.371753 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-ad266b62-d8a1-4eae-9ac7-5036e0511e4d tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/networks?id=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 HTTP/1.1" status: 200  len: 810 time: 0.2044313
May 31 16:24:12.395611 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-b0a5e144-ad8e-44ee-a3b1-d08221328f64 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/quotas/a56002dfed61485aa4d9e237932e1abf HTTP/1.1" status: 200  len: 375 time: 0.0170164
May 31 16:24:12.415950 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 729c3966-0f99-4a7d-ab46-eadab5d24529 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:24:12.416763 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:12.424271 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8a579b0e-94b7-4d27-958b-f2ab6ea417c9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:12.430266 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-7e8cd5d6-6af6-4472-9928-e306c87adcde admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:12.445140 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a579b0e-94b7-4d27-958b-f2ab6ea417c9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=860b379b-4832-4cf9-9ec8-1baa2d76c182,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:12.448777 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-8a579b0e-94b7-4d27-958b-f2ab6ea417c9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:12.450859 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8a579b0e-94b7-4d27-958b-f2ab6ea417c9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:12.452107 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-8a579b0e-94b7-4d27-958b-f2ab6ea417c9 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/860b379b-4832-4cf9-9ec8-1baa2d76c182 HTTP/1.1" status: 204  len: 168 time: 0.2894285
May 31 16:24:12.561202 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-97d45413-6a02-476d-a60b-66520802e126 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=a56002dfed61485aa4d9e237932e1abf&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1513186
May 31 16:24:12.724474 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-0b5fe3a9-d190-4369-8180-5c668e6af265 service neutron] 10.222.0.43 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1621511
May 31 16:24:12.885636 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f9816722-238d-4306-abe3-c321d3c9e4bb service neutron] 10.222.0.43 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1551955
May 31 16:24:13.017787 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-d62f5afd-89b7-4d17-8f21-e3a6ea9392a8 req-1ca8c5fe-3311-49cc-9771-0033b6bfac22 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1008387
May 31 16:24:13.169633 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d62f5afd-89b7-4d17-8f21-e3a6ea9392a8 req-655ca54f-b2b4-4025-a91c-7d38d1091b34 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:13.171217 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-d62f5afd-89b7-4d17-8f21-e3a6ea9392a8 req-655ca54f-b2b4-4025-a91c-7d38d1091b34 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=12203182731d4a61acb7fc5914aef425&device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 1100 time: 0.1239071
May 31 16:24:13.300130 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e6bc9b15-b71e-4241-a1a5-44a47d086157 req-a0f06c3e-2a83-4ff9-a91f-468d4bc19688 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 210 time: 0.1458588
May 31 16:24:13.350734 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3d221a4-030e-499b-b438-3818b8b43c8f req-e5408d03-ab22-489b-874b-df82c6bc1bbd tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:13.352398 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d3d221a4-030e-499b-b438-3818b8b43c8f req-e5408d03-ab22-489b-874b-df82c6bc1bbd tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 984 time: 0.1256118
May 31 16:24:13.396949 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d62f5afd-89b7-4d17-8f21-e3a6ea9392a8 req-6c9f2492-fa45-4a30-8a3a-6dbc1c2e11a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:13.398683 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-d62f5afd-89b7-4d17-8f21-e3a6ea9392a8 req-6c9f2492-fa45-4a30-8a3a-6dbc1c2e11a6 service neutron] 10.222.0.63 "GET /v2.0/networks?id=be7d7603-734f-43bb-92a8-ed07a835aeb5 HTTP/1.1" status: 200  len: 917 time: 0.1992860
May 31 16:24:13.452985 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d3d221a4-030e-499b-b438-3818b8b43c8f req-54352560-4e27-463f-9028-d091e8a0502f tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78&id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0897162
May 31 16:24:13.575416 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-d62f5afd-89b7-4d17-8f21-e3a6ea9392a8 req-a0877f85-0287-4eeb-9e55-27ea5f13d339 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=8cf870c7-bdf1-490f-adfa-61e27997bc91 HTTP/1.1" status: 200  len: 1002 time: 0.1666651
May 31 16:24:13.664885 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d62f5afd-89b7-4d17-8f21-e3a6ea9392a8 req-6b6718aa-ef64-4653-b5e8-62f08bb5c43a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:13.666331 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-d62f5afd-89b7-4d17-8f21-e3a6ea9392a8 req-6b6718aa-ef64-4653-b5e8-62f08bb5c43a service neutron] 10.222.0.63 "GET /v2.0/subnets?id=eb5363fe-ee39-4adc-b299-6098caad681d HTTP/1.1" status: 200  len: 855 time: 0.0825517
May 31 16:24:13.787072 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d62f5afd-89b7-4d17-8f21-e3a6ea9392a8 req-dfd12162-9bd1-46a8-884c-2d58523a8339 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:13.790301 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-d62f5afd-89b7-4d17-8f21-e3a6ea9392a8 req-dfd12162-9bd1-46a8-884c-2d58523a8339 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=be7d7603-734f-43bb-92a8-ed07a835aeb5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1168170
May 31 16:24:14.010744 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-d62f5afd-89b7-4d17-8f21-e3a6ea9392a8 req-3ffad500-07b6-4d70-afa4-06d0c2efdbb2 service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2076623
May 31 16:24:14.168886 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-d62f5afd-89b7-4d17-8f21-e3a6ea9392a8 req-b62a0025-81f4-453d-bb1f-b0d189a630d4 service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1480138
May 31 16:24:14.462760 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ebdc315d-1fda-40a5-bec2-584e2f4cbb5d req-df180855-c867-42be-8fc6-ef538fa9876c tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 210 time: 0.0437908
May 31 16:24:14.648427 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e87cb78-4f41-43a4-8d1b-fdce819a1084 req-5bf816c7-ff04-4ee0-a650-862744117fe2 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:14.650116 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2e87cb78-4f41-43a4-8d1b-fdce819a1084 req-5bf816c7-ff04-4ee0-a650-862744117fe2 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 984 time: 0.0955443
May 31 16:24:14.703465 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2e87cb78-4f41-43a4-8d1b-fdce819a1084 req-85d6b01b-5200-48f1-afc3-707bc2921381 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78&id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0474584
May 31 16:24:14.829025 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-bb418848-04eb-4663-93f4-1450fe431afb tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:14.830528 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-bb418848-04eb-4663-93f4-1450fe431afb tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Synchronizing usage tracker for tenant:a56002dfed61485aa4d9e237932e1abf on resource:network {{(pid=91763) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:24:14.848654 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-bb418848-04eb-4663-93f4-1450fe431afb tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Unset dirty status for tenant:a56002dfed61485aa4d9e237932e1abf on resource:network {{(pid=91763) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:24:14.849801 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-bb418848-04eb-4663-93f4-1450fe431afb tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.63 "GET /v2.0/networks?id=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 HTTP/1.1" status: 200  len: 810 time: 0.1899750
May 31 16:24:14.903710 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-fd3c07ad-6524-4148-9727-82008ef45a1e tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Synchronizing usage tracker for tenant:a56002dfed61485aa4d9e237932e1abf on resource:security_group {{(pid=91763) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:24:14.916477 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-fd3c07ad-6524-4148-9727-82008ef45a1e tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Unset dirty status for tenant:a56002dfed61485aa4d9e237932e1abf on resource:security_group {{(pid=91763) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:24:14.917627 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-fd3c07ad-6524-4148-9727-82008ef45a1e tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.63 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a56002dfed61485aa4d9e237932e1abf HTTP/1.1" status: 200  len: 379 time: 0.0564167
May 31 16:24:14.933929 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-df7dfdae-a14a-4111-bbc0-792328d86157 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Request body: {'port': {'device_id': 'e54682d5-964c-4bf7-b004-5718298ce580', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'admin_state_up': True, 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'security_groups': ['3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb']}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:24:15.103524 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-df7dfdae-a14a-4111-bbc0-792328d86157 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:24:15.108812 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-df7dfdae-a14a-4111-bbc0-792328d86157 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Usage tracker for resource:port and tenant:a56002dfed61485aa4d9e237932e1abf is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:24:15.112999 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-df7dfdae-a14a-4111-bbc0-792328d86157 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Quota usage for port was recalculated. Used quota:3. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:24:15.118819 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-df7dfdae-a14a-4111-bbc0-792328d86157 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:24:15.130829 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-df7dfdae-a14a-4111-bbc0-792328d86157 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Made reservation on behalf of a56002dfed61485aa4d9e237932e1abf for: {'port': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:24:15.134358 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-df7dfdae-a14a-4111-bbc0-792328d86157 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:15.415787 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-df7dfdae-a14a-4111-bbc0-792328d86157 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Allocated IP 172.20.0.8 (cd1ac218-ff8f-46e5-91e3-f1ff613f07d5/6489943b-1236-4d7c-80a7-58ef5aedf09d/cd88a910-8740-4a3f-aafb-41a504f611ee) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:24:15.436838 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-145fc83d-ed3e-455a-8bcc-e06930e47b8b req-50951ce7-37e0-43f0-8148-b7da09dc45e8 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:15.438444 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-145fc83d-ed3e-455a-8bcc-e06930e47b8b req-50951ce7-37e0-43f0-8148-b7da09dc45e8 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=15f6dcaf-fed7-4ab4-88fc-68d4a0db9938 HTTP/1.1" status: 200  len: 945 time: 0.0869277
May 31 16:24:15.494424 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-145fc83d-ed3e-455a-8bcc-e06930e47b8b req-e4d3ba01-a025-4c20-90d9-4dda42fa438c tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0482502
May 31 16:24:15.635094 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-df7dfdae-a14a-4111-bbc0-792328d86157 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:15.651189 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-edc1ba78-456b-479f-bee8-c431deb9450e req-eb8b463e-7fc8-4a5d-9bf6-675013c277f6 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 210 time: 0.0531957
May 31 16:24:15.664810 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.provisioning_blocks [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-df7dfdae-a14a-4111-bbc0-792328d86157 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Transition to ACTIVE for port object cd88a910-8740-4a3f-aafb-41a504f611ee will not be triggered until provisioned by entity DHCP. {{(pid=91763) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:24:15.693171 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-df7dfdae-a14a-4111-bbc0-792328d86157 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:15.700500 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:15.771698 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-df7dfdae-a14a-4111-bbc0-792328d86157 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Network cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:24:15.775756 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-df7dfdae-a14a-4111-bbc0-792328d86157 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:24:15.778430 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-df7dfdae-a14a-4111-bbc0-792328d86157 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:24:15.829434 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df7dfdae-a14a-4111-bbc0-792328d86157 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Pushing event updated for resources: {'Port': ['ID=cd88a910-8740-4a3f-aafb-41a504f611ee,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:15.833402 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-df7dfdae-a14a-4111-bbc0-792328d86157 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:15.879960 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-df7dfdae-a14a-4111-bbc0-792328d86157 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:15.880624 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-df7dfdae-a14a-4111-bbc0-792328d86157 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:15.907944 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-df7dfdae-a14a-4111-bbc0-792328d86157 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.63 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.9778988
May 31 16:24:15.932782 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Request body: {'port': {'device_id': 'e54682d5-964c-4bf7-b004-5718298ce580', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79381'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:24:16.000278 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-870a188c-3b96-476e-9bcb-c516a1f73024 req-cbb2e629-1db0-4d43-97b5-889e37e196b4 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:16.020856 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-870a188c-3b96-476e-9bcb-c516a1f73024 req-cbb2e629-1db0-4d43-97b5-889e37e196b4 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 984 time: 0.1794236
May 31 16:24:16.081451 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-870a188c-3b96-476e-9bcb-c516a1f73024 req-5a0c71cf-988f-48a0-9b38-8104c56c3742 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78&id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0577438
May 31 16:24:16.129339 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:16.137543 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-fbf3ad95-b328-4d96-871b-acaf041e21cd None None] Provisioning for port cd88a910-8740-4a3f-aafb-41a504f611ee completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:24:16.143888 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-fbf3ad95-b328-4d96-871b-acaf041e21cd None None] Provisioning complete for port cd88a910-8740-4a3f-aafb-41a504f611ee triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:24:16.144279 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-fbf3ad95-b328-4d96-871b-acaf041e21cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:16.227864 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-fbf3ad95-b328-4d96-871b-acaf041e21cd None None] Port cd88a910-8740-4a3f-aafb-41a504f611ee cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:24:16.485129 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cd88a910-8740-4a3f-aafb-41a504f611ee {{(pid=91763) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:24:16.492333 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Notify callbacks [] for port, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:16.506487 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.provisioning_blocks [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Transition to ACTIVE for port object cd88a910-8740-4a3f-aafb-41a504f611ee will not be triggered until provisioned by entity L2. {{(pid=91763) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:24:16.509924 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14337082'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:16.514172 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:16.640769 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Pushing event updated for resources: {'Port': ['ID=cd88a910-8740-4a3f-aafb-41a504f611ee,revision_number=2']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:16.685937 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:16.707708 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f71f8884-322b-43e8-bbb4-05911bb9845f req-2419b588-7e10-44c9-8d6a-76e733c5bb58 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:16.709358 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f71f8884-322b-43e8-bbb4-05911bb9845f req-2419b588-7e10-44c9-8d6a-76e733c5bb58 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=15f6dcaf-fed7-4ab4-88fc-68d4a0db9938 HTTP/1.1" status: 200  len: 945 time: 0.1037662
May 31 16:24:16.760456 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f71f8884-322b-43e8-bbb4-05911bb9845f req-0b331f4a-4fb3-4ccb-a1b8-6a05009ba081 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0451849
May 31 16:24:16.769674 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Attempting to bind port cd88a910-8740-4a3f-aafb-41a504f611ee on host hv-cinder-79381 for vnic_type normal with profile  {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:24:16.770034 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Attempting to bind port cd88a910-8740-4a3f-aafb-41a504f611ee by drivers openvswitch,hyperv on host hv-cinder-79381 at level 0 using segments [{'id': '1974822a-78ff-4607-935a-c9f5ba4a898d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5'}] {{(pid=91763) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:24:16.770363 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Attempting to bind port cd88a910-8740-4a3f-aafb-41a504f611ee on network cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:24:16.775637 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Port cd88a910-8740-4a3f-aafb-41a504f611ee on network cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79381 {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 31 16:24:16.775966 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Attempting to bind port cd88a910-8740-4a3f-aafb-41a504f611ee on network cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:24:16.781466 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Checking agent: {'id': '4bed2638-4d91-4afb-bf81-aacca8584621', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79381', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'started_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 23, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:24:16.782086 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Checking segment: {'id': '1974822a-78ff-4607-935a-c9f5ba4a898d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91763) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:24:16.782280 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Bound using segment: {'id': '1974822a-78ff-4607-935a-c9f5ba4a898d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5'} {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:24:16.782669 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Bound port: cd88a910-8740-4a3f-aafb-41a504f611ee, host: hv-cinder-79381, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1974822a-78ff-4607-935a-c9f5ba4a898d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5'}}] {{(pid=91763) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:24:16.783770 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:16.868455 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12e0d761-04f7-43ea-baf7-178b8acebe47 req-6bff0975-f846-4c54-912a-621e20bf9424 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:16.870329 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-12e0d761-04f7-43ea-baf7-178b8acebe47 req-6bff0975-f846-4c54-912a-621e20bf9424 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 943 time: 0.0926926
May 31 16:24:16.882116 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] For port cd88a910-8740-4a3f-aafb-41a504f611ee, host hv-cinder-79381, cleared binding levels {{(pid=91763) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:24:16.885224 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] For port cd88a910-8740-4a3f-aafb-41a504f611ee, host hv-cinder-79381, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=cd88a910-8740-4a3f-aafb-41a504f611ee,segment=NetworkSegment(1974822a-78ff-4607-935a-c9f5ba4a898d),segment_id=1974822a-78ff-4607-935a-c9f5ba4a898d)] {{(pid=91763) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:24:16.890979 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14337082'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:16.896797 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-90dea672-1b14-4609-9929-b3666b9b6c00 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:16.924781 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-12e0d761-04f7-43ea-baf7-178b8acebe47 req-cf042e83-8ec0-45f8-908f-8fcd6b02269a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0468209
May 31 16:24:16.956611 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:16.957217 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:16.958590 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] 10.222.0.63 "PUT /v2.0/ports/cd88a910-8740-4a3f-aafb-41a504f611ee HTTP/1.1" status: 200  len: 1093 time: 1.0317996
May 31 16:24:16.959086 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e54682d5-964c-4bf7-b004-5718298ce580', 'tag': 'cd88a910-8740-4a3f-aafb-41a504f611ee'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:24:16.961364 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a5b4ea65-6607-42da-80b0-f87312879e9e" -d '{"events": [{"name": "network-changed", "server_uuid": "e54682d5-964c-4bf7-b004-5718298ce580", "tag": "cd88a910-8740-4a3f-aafb-41a504f611ee"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:24:16.991490 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Pushing event updated for resources: {'Port': ['ID=cd88a910-8740-4a3f-aafb-41a504f611ee,revision_number=3']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:17.004058 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:17.037486 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:24:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d097c754-253e-4a19-9176-2c6ef8f60d73 x-openstack-request-id: req-d097c754-253e-4a19-9176-2c6ef8f60d73 {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:24:17.037835 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e54682d5-964c-4bf7-b004-5718298ce580", "tag": "cd88a910-8740-4a3f-aafb-41a504f611ee", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:24:17.038113 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-d097c754-253e-4a19-9176-2c6ef8f60d73 {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:24:17.038647 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e54682d5-964c-4bf7-b004-5718298ce580', 'tag': 'cd88a910-8740-4a3f-aafb-41a504f611ee', 'status': 'completed', 'code': 200}
May 31 16:24:17.086694 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-a1bde297-d504-4c33-893d-aaf7e811921b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:17.088368 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-a1bde297-d504-4c33-893d-aaf7e811921b service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=a56002dfed61485aa4d9e237932e1abf&device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 1096 time: 0.0831013
May 31 16:24:17.165546 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-e1a0db22-d9c0-4061-a100-8c8cd830bab6 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=cd88a910-8740-4a3f-aafb-41a504f611ee HTTP/1.1" status: 200  len: 217 time: 0.0677650
May 31 16:24:17.168588 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:24:17.246690 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-1442b5e0-aa0f-4c34-87ca-dd9f28d634da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:17.248160 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-1442b5e0-aa0f-4c34-87ca-dd9f28d634da service neutron] 10.222.0.63 "GET /v2.0/subnets?id=6489943b-1236-4d7c-80a7-58ef5aedf09d HTTP/1.1" status: 200  len: 849 time: 0.0745945
May 31 16:24:17.294252 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18742e54-0518-4a43-83fe-0bb4e0962d89 req-3d7ec27a-26bd-4d29-9e4b-e22d5fcb6063 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:17.295723 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-18742e54-0518-4a43-83fe-0bb4e0962d89 req-3d7ec27a-26bd-4d29-9e4b-e22d5fcb6063 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 984 time: 0.0901723
May 31 16:24:17.335648 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-62c9773a-c9b0-47bc-8e0b-6f1930db84a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:17.337390 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-62c9773a-c9b0-47bc-8e0b-6f1930db84a2 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0814652
May 31 16:24:17.352339 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-18742e54-0518-4a43-83fe-0bb4e0962d89 req-8b9af097-0136-4eaa-b374-7df5ba96ad7f tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78&id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0498376
May 31 16:24:17.514197 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5def6b1c-e8f1-4a4c-b09f-9bbbe0845d57 req-a5354db5-2c3b-4c4e-95da-009c0ee2afed tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:17.515830 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5def6b1c-e8f1-4a4c-b09f-9bbbe0845d57 req-a5354db5-2c3b-4c4e-95da-009c0ee2afed tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.63 "GET /v2.0/ports?device_id=15f6dcaf-fed7-4ab4-88fc-68d4a0db9938 HTTP/1.1" status: 200  len: 945 time: 0.0903056
May 31 16:24:17.573400 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-9f7c6f81-9ce6-4ea1-a7de-4477347e257a service neutron] 10.222.0.63 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2265053
May 31 16:24:17.658219 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [req-5def6b1c-e8f1-4a4c-b09f-9bbbe0845d57 req-10337ac0-366b-4697-ad9a-ea841e307fa2 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Deleting port cef796b2-4c34-4037-848d-45c6d9f72fd4 {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:24:17.658722 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-5def6b1c-e8f1-4a4c-b09f-9bbbe0845d57 req-10337ac0-366b-4697-ad9a-ea841e307fa2 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:17.745244 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-90b30cea-b2ed-4fd9-9bdc-76883ff7e7cf req-77b5ab8e-73d0-49b3-9384-c8186fb4c09e service neutron] 10.222.0.63 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1642151
May 31 16:24:17.895674 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b4ea65-6607-42da-80b0-f87312879e9e req-370cf917-c2c7-4342-b38a-cc86f246b779 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:17.897131 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-a5b4ea65-6607-42da-80b0-f87312879e9e req-370cf917-c2c7-4342-b38a-cc86f246b779 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=a56002dfed61485aa4d9e237932e1abf&device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 1096 time: 0.0891502
May 31 16:24:17.957281 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-5def6b1c-e8f1-4a4c-b09f-9bbbe0845d57 req-10337ac0-366b-4697-ad9a-ea841e307fa2 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] For port cef796b2-4c34-4037-848d-45c6d9f72fd4, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=cef796b2-4c34-4037-848d-45c6d9f72fd4,segment=NetworkSegment(54d58804-a1bf-4e3a-8d44-cdd8f5cc124a),segment_id=54d58804-a1bf-4e3a-8d44-cdd8f5cc124a)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:24:17.957939 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-5def6b1c-e8f1-4a4c-b09f-9bbbe0845d57 req-10337ac0-366b-4697-ad9a-ea841e307fa2 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:18.047423 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b4ea65-6607-42da-80b0-f87312879e9e req-ea0bb8d3-70ed-40d9-b644-895faa56877c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:18.049778 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-a5b4ea65-6607-42da-80b0-f87312879e9e req-ea0bb8d3-70ed-40d9-b644-895faa56877c service neutron] 10.222.0.63 "GET /v2.0/networks?id=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 HTTP/1.1" status: 200  len: 911 time: 0.1432900
May 31 16:24:18.091543 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [req-5def6b1c-e8f1-4a4c-b09f-9bbbe0845d57 req-10337ac0-366b-4697-ad9a-ea841e307fa2 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Calling delete_port for cef796b2-4c34-4037-848d-45c6d9f72fd4 owned by compute:nova {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:24:18.123129 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-a5b4ea65-6607-42da-80b0-f87312879e9e req-fc1f11ad-9616-4cf3-8246-c4f31264bff5 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=cd88a910-8740-4a3f-aafb-41a504f611ee HTTP/1.1" status: 200  len: 217 time: 0.0671604
May 31 16:24:18.192591 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b4ea65-6607-42da-80b0-f87312879e9e req-e835ed96-9a8d-4121-853a-e2dab644c096 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:18.194457 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-a5b4ea65-6607-42da-80b0-f87312879e9e req-e835ed96-9a8d-4121-853a-e2dab644c096 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=6489943b-1236-4d7c-80a7-58ef5aedf09d HTTP/1.1" status: 200  len: 849 time: 0.0637741
May 31 16:24:18.199392 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f34ce2a-44a2-462b-b599-2ae23dbda560 req-59f0a921-c30b-4750-ae04-16069a1c7a64 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:18.200870 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9f34ce2a-44a2-462b-b599-2ae23dbda560 req-59f0a921-c30b-4750-ae04-16069a1c7a64 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=15f6dcaf-fed7-4ab4-88fc-68d4a0db9938 HTTP/1.1" status: 200  len: 945 time: 0.3121393
May 31 16:24:18.248506 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffdd8aa1-83e7-4c09-9d2b-06f31a0647d9 req-1895f634-caf5-441e-800a-6a986a67396b tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:18.250307 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ffdd8aa1-83e7-4c09-9d2b-06f31a0647d9 req-1895f634-caf5-441e-800a-6a986a67396b tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 943 time: 0.1657488
May 31 16:24:18.279849 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b4ea65-6607-42da-80b0-f87312879e9e req-88d39f80-43a5-4104-9401-981565fd4b10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:18.281738 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-a5b4ea65-6607-42da-80b0-f87312879e9e req-88d39f80-43a5-4104-9401-981565fd4b10 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0780022
May 31 16:24:18.322908 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9f34ce2a-44a2-462b-b599-2ae23dbda560 req-f79ef24f-ec62-473f-b323-55fd4ab724e3 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1147380
May 31 16:24:18.370863 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ffdd8aa1-83e7-4c09-9d2b-06f31a0647d9 req-dfe3edf9-7111-4708-9f72-7048b893b689 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1074257
May 31 16:24:18.385946 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-5def6b1c-e8f1-4a4c-b09f-9bbbe0845d57 req-10337ac0-366b-4697-ad9a-ea841e307fa2 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:18.393493 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-b6931456-08a5-41c6-b8a1-02f91858f116 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:18.399351 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['cef796b2-4c34-4037-848d-45c6d9f72fd4'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:24:18.428552 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-a5b4ea65-6607-42da-80b0-f87312879e9e req-5e09119e-ccf2-4347-ad6b-cb3ba4a5391a service neutron] 10.222.0.63 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1362941
May 31 16:24:18.448703 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10337ac0-366b-4697-ad9a-ea841e307fa2 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Pushing event deleted for resources: {'Port': ['ID=cef796b2-4c34-4037-848d-45c6d9f72fd4,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:18.452296 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-10337ac0-366b-4697-ad9a-ea841e307fa2 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:18.572276 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [req-5def6b1c-e8f1-4a4c-b09f-9bbbe0845d57 req-10337ac0-366b-4697-ad9a-ea841e307fa2 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] No DVR routers for this DVR port cef796b2-4c34-4037-848d-45c6d9f72fd4 on host hv-cinder-79381 {{(pid=91764) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:24:18.574201 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-a5b4ea65-6607-42da-80b0-f87312879e9e req-d8c89445-4572-4db9-96b4-6e6727595f1e service neutron] 10.222.0.63 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1348286
May 31 16:24:18.575859 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-5def6b1c-e8f1-4a4c-b09f-9bbbe0845d57 req-10337ac0-366b-4697-ad9a-ea841e307fa2 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:18.578392 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '15f6dcaf-fed7-4ab4-88fc-68d4a0db9938', 'name': 'network-vif-deleted', 'tag': 'cef796b2-4c34-4037-848d-45c6d9f72fd4'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:24:18.580673 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7db0cc68-a805-46fd-8816-1dd2cd7904f4" -d '{"events": [{"server_uuid": "15f6dcaf-fed7-4ab4-88fc-68d4a0db9938", "name": "network-vif-deleted", "tag": "cef796b2-4c34-4037-848d-45c6d9f72fd4"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:24:18.607778 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5def6b1c-e8f1-4a4c-b09f-9bbbe0845d57 req-10337ac0-366b-4697-ad9a-ea841e307fa2 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.63 "DELETE /v2.0/ports/cef796b2-4c34-4037-848d-45c6d9f72fd4 HTTP/1.1" status: 204  len: 173 time: 1.0854137
May 31 16:24:18.624814 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:24:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e27d217c-ffec-4774-9ba9-4bb449589e60 x-openstack-request-id: req-e27d217c-ffec-4774-9ba9-4bb449589e60 {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:24:18.625137 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "15f6dcaf-fed7-4ab4-88fc-68d4a0db9938", "name": "network-vif-deleted", "tag": "cef796b2-4c34-4037-848d-45c6d9f72fd4", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:24:18.625415 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-e27d217c-ffec-4774-9ba9-4bb449589e60 {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:24:18.625860 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '15f6dcaf-fed7-4ab4-88fc-68d4a0db9938', 'name': 'network-vif-deleted', 'tag': 'cef796b2-4c34-4037-848d-45c6d9f72fd4', 'status': 'completed', 'code': 200}
May 31 16:24:18.639130 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-280ad312-ac01-4215-99cd-6e7a34363a06 req-4fd53f06-d200-4482-9d02-464b7d220242 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:18.640637 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-280ad312-ac01-4215-99cd-6e7a34363a06 req-4fd53f06-d200-4482-9d02-464b7d220242 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 984 time: 0.1501551
May 31 16:24:18.692338 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-280ad312-ac01-4215-99cd-6e7a34363a06 req-b4c67eb7-60c3-4383-acf9-e6c036e9ea4e tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78&id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0433118
May 31 16:24:19.603704 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ae2177c-d3ca-4889-80a8-66ed9b9c33fd req-de0c39e5-ad25-4b74-82aa-95297629de5a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:19.605261 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0ae2177c-d3ca-4889-80a8-66ed9b9c33fd req-de0c39e5-ad25-4b74-82aa-95297629de5a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 943 time: 0.0965614
May 31 16:24:19.644579 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:19.712034 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0ae2177c-d3ca-4889-80a8-66ed9b9c33fd req-20ae018b-38e3-4036-992b-65f8e1e02b44 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0862432
May 31 16:24:19.904160 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6e39cb4-109b-405a-9f08-1ffcb3e1b2b1 req-261cd4fb-550b-447a-8e5d-9484bf287d68 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:19.906540 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f6e39cb4-109b-405a-9f08-1ffcb3e1b2b1 req-261cd4fb-550b-447a-8e5d-9484bf287d68 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 984 time: 0.0889313
May 31 16:24:19.955716 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f6e39cb4-109b-405a-9f08-1ffcb3e1b2b1 req-8f5079db-a23a-46b9-8ac6-738cb8807409 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78&id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0434046
May 31 16:24:20.918833 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bff87f24-9e0a-4931-9980-bf911630c28b req-8f3b1eaf-33ab-43f0-a5aa-2e0a51ba3b17 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:20.920273 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bff87f24-9e0a-4931-9980-bf911630c28b req-8f3b1eaf-33ab-43f0-a5aa-2e0a51ba3b17 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 943 time: 0.0867710
May 31 16:24:20.964384 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bff87f24-9e0a-4931-9980-bf911630c28b req-f438a982-9753-4d09-b9d3-84779e97ab9f tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0377605
May 31 16:24:20.972793 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device cd88a910-8740-4a3f-aafb-41a504f611ee details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:24:21.111349 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port cd88a910-8740-4a3f-aafb-41a504f611ee, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=cd88a910-8740-4a3f-aafb-41a504f611ee,segment=NetworkSegment(1974822a-78ff-4607-935a-c9f5ba4a898d),segment_id=1974822a-78ff-4607-935a-c9f5ba4a898d)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:24:21.124879 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': 'cd88a910-8740-4a3f-aafb-41a504f611ee', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'port_id': 'cd88a910-8740-4a3f-aafb-41a504f611ee', 'mac_address': 'fa:16:3e:97:66:a5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 833, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:24:21.161599 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1009770f-3796-4dfe-a327-20472345b68b req-76e60121-05fb-42b2-8934-27b0864e24ef tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:21.163713 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1009770f-3796-4dfe-a327-20472345b68b req-76e60121-05fb-42b2-8934-27b0864e24ef tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 984 time: 0.0855157
May 31 16:24:21.185130 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:21.203312 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cd88a910-8740-4a3f-aafb-41a504f611ee {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:24:21.215806 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1009770f-3796-4dfe-a327-20472345b68b req-6df66452-4926-4dae-8916-6b9c7cde7b4f tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78&id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0469646
May 31 16:24:21.219053 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port cd88a910-8740-4a3f-aafb-41a504f611ee, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=cd88a910-8740-4a3f-aafb-41a504f611ee,segment=NetworkSegment(1974822a-78ff-4607-935a-c9f5ba4a898d),segment_id=1974822a-78ff-4607-935a-c9f5ba4a898d)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:24:21.223663 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:21.225392 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-97fafd75-a3e0-4389-b16f-a822f16d4fd0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:21.294301 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=cd88a910-8740-4a3f-aafb-41a504f611ee,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:21.297320 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:22.158309 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77710bf4-6dd1-4af8-92d4-39a8e80a3e68 req-527a65fa-7a93-4d8d-ad03-b5c6ce0c3c52 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:22.159693 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-77710bf4-6dd1-4af8-92d4-39a8e80a3e68 req-527a65fa-7a93-4d8d-ad03-b5c6ce0c3c52 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 944 time: 0.0842204
May 31 16:24:22.205004 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-77710bf4-6dd1-4af8-92d4-39a8e80a3e68 req-b013aab6-5275-4ff6-b59f-9770673ae60d tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0396152
May 31 16:24:22.403668 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f122c1a-bf10-43e9-8c2d-2f751eb0a1a1 req-9f2c635e-b1f7-43da-b351-41e374b4c812 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:22.405080 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1f122c1a-bf10-43e9-8c2d-2f751eb0a1a1 req-9f2c635e-b1f7-43da-b351-41e374b4c812 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 984 time: 0.0835133
May 31 16:24:22.451152 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1f122c1a-bf10-43e9-8c2d-2f751eb0a1a1 req-7411a331-0a0a-4e67-84d2-50ff833d346b tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78&id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0400493
May 31 16:24:23.240973 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['cd88a910-8740-4a3f-aafb-41a504f611ee'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:24:23.407715 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67bd3abe-3014-45b9-a04f-0b63b3c67f75 req-f8c76762-3ab2-4cd8-894e-97cde518c635 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:23.409338 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-67bd3abe-3014-45b9-a04f-0b63b3c67f75 req-f8c76762-3ab2-4cd8-894e-97cde518c635 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 944 time: 0.0926864
May 31 16:24:23.460186 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-67bd3abe-3014-45b9-a04f-0b63b3c67f75 req-25ea10f9-7dce-4b84-be29-c6d799c0c5d5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0423863
May 31 16:24:23.648033 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6731d036-00c6-47a8-8254-76244accec00 req-2efb74bf-88e0-41c9-b01f-0c4b97a2433f tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:23.649490 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6731d036-00c6-47a8-8254-76244accec00 req-2efb74bf-88e0-41c9-b01f-0c4b97a2433f tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 984 time: 0.0853043
May 31 16:24:23.698313 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6731d036-00c6-47a8-8254-76244accec00 req-d88c3ca6-6dfb-4d37-b6ea-837c3313b046 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78&id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0428064
May 31 16:24:24.651440 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ce81650-aa57-48cc-884d-9d65a37a5103 req-dc52a98e-238a-407b-924d-ad18862ff203 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:24.652934 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0ce81650-aa57-48cc-884d-9d65a37a5103 req-dc52a98e-238a-407b-924d-ad18862ff203 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 944 time: 0.0842800
May 31 16:24:24.702977 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0ce81650-aa57-48cc-884d-9d65a37a5103 req-71087662-fe90-4ff0-b94d-577e1f323e52 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0440686
May 31 16:24:24.880114 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device cd88a910-8740-4a3f-aafb-41a504f611ee up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:24:24.952808 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning for port cd88a910-8740-4a3f-aafb-41a504f611ee completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:24:24.957961 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port cd88a910-8740-4a3f-aafb-41a504f611ee triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:24:24.958344 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:24.977006 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90429ae4-ce3f-4c35-b9dd-446a7f3c0be5 req-302573b5-5ba7-44a8-aa1c-e94c61fcb3d6 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:24.978601 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-90429ae4-ce3f-4c35-b9dd-446a7f3c0be5 req-302573b5-5ba7-44a8-aa1c-e94c61fcb3d6 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 984 time: 0.1678531
May 31 16:24:25.041614 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-90429ae4-ce3f-4c35-b9dd-446a7f3c0be5 req-87bc11c6-cc9d-4cb4-901d-9379d463a09d tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78&id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0570350
May 31 16:24:25.082040 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:25.116415 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e54682d5-964c-4bf7-b004-5718298ce580', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cd88a910-8740-4a3f-aafb-41a504f611ee'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:24:25.118650 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-488cd43d-7d7b-498d-8b39-c685d3274d6b" -d '{"events": [{"server_uuid": "e54682d5-964c-4bf7-b004-5718298ce580", "name": "network-vif-plugged", "status": "completed", "tag": "cd88a910-8740-4a3f-aafb-41a504f611ee"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:24:25.127247 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port cd88a910-8740-4a3f-aafb-41a504f611ee, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=cd88a910-8740-4a3f-aafb-41a504f611ee,segment=NetworkSegment(1974822a-78ff-4607-935a-c9f5ba4a898d),segment_id=1974822a-78ff-4607-935a-c9f5ba4a898d)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:24:25.131411 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:25.132288 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device cef796b2-4c34-4037-848d-45c6d9f72fd4 no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:24:25.161676 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:25.200082 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:24:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-99a76b71-10e3-4a1c-a21c-e567100e4019 x-openstack-request-id: req-99a76b71-10e3-4a1c-a21c-e567100e4019 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:24:25.200381 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e54682d5-964c-4bf7-b004-5718298ce580", "name": "network-vif-plugged", "status": "completed", "tag": "cd88a910-8740-4a3f-aafb-41a504f611ee", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:24:25.200642 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-99a76b71-10e3-4a1c-a21c-e567100e4019 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:24:25.201031 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e54682d5-964c-4bf7-b004-5718298ce580', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cd88a910-8740-4a3f-aafb-41a504f611ee', 'code': 200}
May 31 16:24:25.208329 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] No Port match for: cef796b2-4c34-4037-848d-45c6d9f72fd4 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:24:25.208684 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device cef796b2-4c34-4037-848d-45c6d9f72fd4 not bound to the agent host hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:24:25.237064 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=cd88a910-8740-4a3f-aafb-41a504f611ee,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:25.240440 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:25.410544 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd0fcdd4-e989-46fa-9499-da28f35c6f2d req-1e4d655a-363b-4c3f-b63c-7aac56bd1fcc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:25.411998 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bd0fcdd4-e989-46fa-9499-da28f35c6f2d req-1e4d655a-363b-4c3f-b63c-7aac56bd1fcc service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 1098 time: 0.0747564
May 31 16:24:25.459288 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bd0fcdd4-e989-46fa-9499-da28f35c6f2d req-bfff8e3e-9c7d-42de-801a-5f68ba0cdcfd service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0348887
May 31 16:24:25.898222 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5e89075-2c22-497b-b1d4-f2ce699729e7 req-2fca4f54-91f9-4e02-b355-be335cc178ee tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:25.899772 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e5e89075-2c22-497b-b1d4-f2ce699729e7 req-2fca4f54-91f9-4e02-b355-be335cc178ee tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.0864749
May 31 16:24:25.952025 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e5e89075-2c22-497b-b1d4-f2ce699729e7 req-70f51e65-c94b-48d6-b7e6-98b9133670b6 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0461879
May 31 16:24:26.219389 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 34756) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:24:26.342272 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:26.357993 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:24:26.362254 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Usage tracker for resource:security_group_rule and tenant:e941f0fc32ab453db7e3d9f1c151a653 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:24:26.365094 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:24:26.370843 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:24:26.455663 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:26.459918 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:26.466950 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-0a8aaa82-d13a-4a55-b3d6-c0c0a56fa676 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:26.514636 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=e941f0fc32ab453db7e3d9f1c151a653&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2934716
May 31 16:24:26.515567 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c8b54ef8-7612-409a-b683-04a326b07d06,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:26.517284 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 34764) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:24:26.524591 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:26.525086 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:26.525610 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:26.526062 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:26.526524 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:26.526986 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:26.527478 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:26.527928 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:26.528385 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:26.529112 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:26.529390 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:26.529778 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:26.534634 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:26.581494 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c90de5cc-c820-4243-a651-66f756c4958f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:26.607498 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c90de5cc-c820-4243-a651-66f756c4958f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:26.658629 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c90de5cc-c820-4243-a651-66f756c4958f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:26.663308 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-bc243934-e24a-4488-8be9-cc0d56ffad51 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:26.675186 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c90de5cc-c820-4243-a651-66f756c4958f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c8b54ef8-7612-409a-b683-04a326b07d06,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:26.678106 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c90de5cc-c820-4243-a651-66f756c4958f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:26.680097 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c90de5cc-c820-4243-a651-66f756c4958f admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:26.681172 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-c90de5cc-c820-4243-a651-66f756c4958f admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/c8b54ef8-7612-409a-b683-04a326b07d06 HTTP/1.1" status: 204  len: 168 time: 0.1628268
May 31 16:24:27.170322 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abc01edb-47e7-4ab3-9fe2-e8425a511f5a req-f2bffac1-8f40-488e-8e0e-2989d11522e4 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:27.171797 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-abc01edb-47e7-4ab3-9fe2-e8425a511f5a req-f2bffac1-8f40-488e-8e0e-2989d11522e4 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.0893111
May 31 16:24:27.217689 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-abc01edb-47e7-4ab3-9fe2-e8425a511f5a req-d65e3097-20e3-49e6-9adc-29219fc30315 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0398452
May 31 16:24:28.412622 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e819dacc-d73e-46c7-903a-0b52c96098fc req-f5a13c0f-1b0f-4f82-b01e-d7ff59761eef tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:28.414148 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e819dacc-d73e-46c7-903a-0b52c96098fc req-f5a13c0f-1b0f-4f82-b01e-d7ff59761eef tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.0866513
May 31 16:24:28.467506 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e819dacc-d73e-46c7-903a-0b52c96098fc req-71eef569-ffff-4445-b746-4f27faab9ac4 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0399687
May 31 16:24:28.519566 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 34824) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:24:28.641453 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7424d25d-ffcd-4431-9071-7638e8cd2864 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:28.657030 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-7424d25d-ffcd-4431-9071-7638e8cd2864 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:24:28.662022 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-7424d25d-ffcd-4431-9071-7638e8cd2864 admin admin] Usage tracker for resource:security_group_rule and tenant:dc1c8bee1d0d4f37862479814a4c99b3 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:24:28.664904 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-7424d25d-ffcd-4431-9071-7638e8cd2864 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:24:28.670776 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-7424d25d-ffcd-4431-9071-7638e8cd2864 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:24:28.757686 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7424d25d-ffcd-4431-9071-7638e8cd2864 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:28.761759 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7424d25d-ffcd-4431-9071-7638e8cd2864 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:28.769115 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-97222ae9-67eb-467a-a23c-0c7a6b0a3274 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:28.811334 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-7424d25d-ffcd-4431-9071-7638e8cd2864 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=dc1c8bee1d0d4f37862479814a4c99b3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2906547
May 31 16:24:28.812228 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7424d25d-ffcd-4431-9071-7638e8cd2864 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b3887cb-eb70-465f-b444-78ae0098c837,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:28.816001 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 34832) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:24:28.816191 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-7424d25d-ffcd-4431-9071-7638e8cd2864 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:28.888557 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-a1d331fd-c1a4-477f-bd95-0713e7ebc863 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:28.922041 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-a1d331fd-c1a4-477f-bd95-0713e7ebc863 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:28.990041 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-a1d331fd-c1a4-477f-bd95-0713e7ebc863 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:28.994077 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c42d3d32-c73f-41a6-94d0-20e6c77ad8e7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:29.008207 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1d331fd-c1a4-477f-bd95-0713e7ebc863 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b3887cb-eb70-465f-b444-78ae0098c837,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:29.010495 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-a1d331fd-c1a4-477f-bd95-0713e7ebc863 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:29.014580 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-a1d331fd-c1a4-477f-bd95-0713e7ebc863 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:29.019070 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-a1d331fd-c1a4-477f-bd95-0713e7ebc863 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/1b3887cb-eb70-465f-b444-78ae0098c837 HTTP/1.1" status: 204  len: 168 time: 0.2015712
May 31 16:24:29.330845 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 34840) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:24:29.349096 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-45815ddc-3ba0-4941-8cf2-917c101a892a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:29.363169 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-45815ddc-3ba0-4941-8cf2-917c101a892a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:24:29.367041 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-45815ddc-3ba0-4941-8cf2-917c101a892a admin admin] Usage tracker for resource:security_group_rule and tenant:d2ca250b186844b3b269864f6f4026bc is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:24:29.369866 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-45815ddc-3ba0-4941-8cf2-917c101a892a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:24:29.376567 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-45815ddc-3ba0-4941-8cf2-917c101a892a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:24:29.459583 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-45815ddc-3ba0-4941-8cf2-917c101a892a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:29.463377 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-45815ddc-3ba0-4941-8cf2-917c101a892a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:29.469598 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-04952c73-ca57-41e0-a689-2f0c708b3c55 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:29.510920 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45815ddc-3ba0-4941-8cf2-917c101a892a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d9815675-2058-4fe7-8e60-d2aa41da8baa,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:29.515207 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-45815ddc-3ba0-4941-8cf2-917c101a892a admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=d2ca250b186844b3b269864f6f4026bc&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1833241
May 31 16:24:29.516094 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-45815ddc-3ba0-4941-8cf2-917c101a892a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:29.518676 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 34846) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:24:29.622271 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-2647ff7f-00b2-4e81-86a8-a270fe33e447 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:29.659785 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-2647ff7f-00b2-4e81-86a8-a270fe33e447 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:29.713727 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96f3d3c8-6312-49ad-bbdf-c7de1bcd9946 req-4cea5195-d4e5-4a51-b604-7b947ecba05f tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:29.715194 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-96f3d3c8-6312-49ad-bbdf-c7de1bcd9946 req-4cea5195-d4e5-4a51-b604-7b947ecba05f tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.1397033
May 31 16:24:29.759194 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-2647ff7f-00b2-4e81-86a8-a270fe33e447 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:29.766355 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c29fb5cf-adfe-4f7a-b652-caddafd9823a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:29.778821 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-96f3d3c8-6312-49ad-bbdf-c7de1bcd9946 req-3f207d2e-eb4a-466c-b2f0-f3710bfec19c tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0571601
May 31 16:24:29.784508 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2647ff7f-00b2-4e81-86a8-a270fe33e447 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d9815675-2058-4fe7-8e60-d2aa41da8baa,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:29.787195 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-2647ff7f-00b2-4e81-86a8-a270fe33e447 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:29.788431 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-2647ff7f-00b2-4e81-86a8-a270fe33e447 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:29.789541 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-2647ff7f-00b2-4e81-86a8-a270fe33e447 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/d9815675-2058-4fe7-8e60-d2aa41da8baa HTTP/1.1" status: 204  len: 168 time: 0.2699356
May 31 16:24:30.085303 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17ae9474-4fb1-4054-a487-d4c5ce5a2e1e req-11ba171f-3908-4b6d-8d34-112f5972db92 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:30.086856 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-17ae9474-4fb1-4054-a487-d4c5ce5a2e1e req-11ba171f-3908-4b6d-8d34-112f5972db92 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.2044861
May 31 16:24:30.102083 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 34870) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:24:30.104257 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-27038eb2-c8ff-477c-ac69-803867e16d9d tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:30.105727 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-27038eb2-c8ff-477c-ac69-803867e16d9d tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/networks?id=52011424-acd2-4b1b-9a3c-ebda39ad09da HTTP/1.1" status: 200  len: 814 time: 0.1876075
May 31 16:24:30.108828 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-8eee7e87-c911-4e8d-911f-a455e44871a4 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Request body: {'floatingip': {'port_id': 'cd88a910-8740-4a3f-aafb-41a504f611ee'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:24:30.196438 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-dfb4b02f-2a54-4205-be8c-fc28aafe2bce tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/quotas/8f633dd4e3b241db904e4505f98ebe62 HTTP/1.1" status: 200  len: 375 time: 0.0270081
May 31 16:24:30.198817 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-8eee7e87-c911-4e8d-911f-a455e44871a4 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for floatingip, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:30.353634 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-ab018761-f88c-49ba-aaed-e34a015f1019 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Synchronizing usage tracker for tenant:8f633dd4e3b241db904e4505f98ebe62 on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:24:30.387441 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-ab018761-f88c-49ba-aaed-e34a015f1019 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Unset dirty status for tenant:8f633dd4e3b241db904e4505f98ebe62 on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:24:30.388720 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-ab018761-f88c-49ba-aaed-e34a015f1019 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=8f633dd4e3b241db904e4505f98ebe62&fields=id HTTP/1.1" status: 200  len: 210 time: 0.1316135
May 31 16:24:30.808435 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-0b48b1ce-fc66-4835-a63f-51bd05962d6a service neutron] 10.222.0.43 "GET /v2.0/networks/52011424-acd2-4b1b-9a3c-ebda39ad09da?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3893802
May 31 16:24:31.060371 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-6e49201b-194c-4ad6-a104-d99f545c17ca service neutron] 10.222.0.43 "GET /v2.0/networks/52011424-acd2-4b1b-9a3c-ebda39ad09da?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2430577
May 31 16:24:31.210336 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-8eee7e87-c911-4e8d-911f-a455e44871a4 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:31.248908 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-8eee7e87-c911-4e8d-911f-a455e44871a4 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16621821'] for floatingip, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:31.318538 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-356a3a15-b9ba-44c4-9261-955a71932328 req-b4eff919-0b6f-4fb7-9a4d-20008067514f tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 210 time: 0.1070187
May 31 16:24:31.467200 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.db.l3_db [None req-8eee7e87-c911-4e8d-911f-a455e44871a4 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Floating IP db61d3b9-2e31-486b-8dd2-212bf03ec982 associated. External IP: 172.27.0.98, port: cd88a910-8740-4a3f-aafb-41a504f611ee.
May 31 16:24:31.888740 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8eee7e87-c911-4e8d-911f-a455e44871a4 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Router 2bcd5afd-bdf4-472d-8a91-95997718441c has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91764) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:24:32.236429 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8eee7e87-c911-4e8d-911f-a455e44871a4 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91764) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:24:32.241339 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-8eee7e87-c911-4e8d-911f-a455e44871a4 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for floatingip, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:32.246078 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9e82451-8f03-4ea5-a5b0-4feb72e61a10 None None] Sync routers for ids ['2bcd5afd-bdf4-472d-8a91-95997718441c'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:24:32.258320 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9e82451-8f03-4ea5-a5b0-4feb72e61a10 None None] Routers {'2bcd5afd-bdf4-472d-8a91-95997718441c'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:24:32.258955 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-e9e82451-8f03-4ea5-a5b0-4feb72e61a10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426132dc0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:24:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['2bcd5afd-bdf4-472d-8a91-95997718441c'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:24:32.303948 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-8eee7e87-c911-4e8d-911f-a455e44871a4 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "PUT /v2.0/floatingips/db61d3b9-2e31-486b-8dd2-212bf03ec982 HTTP/1.1" status: 200  len: 990 time: 2.2072589
May 31 16:24:32.304656 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e54682d5-964c-4bf7-b004-5718298ce580', 'tag': 'cd88a910-8740-4a3f-aafb-41a504f611ee'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:24:32.307494 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7c4f68a0-da1b-4de6-9661-7fc2fb52ac63" -d '{"events": [{"name": "network-changed", "server_uuid": "e54682d5-964c-4bf7-b004-5718298ce580", "tag": "cd88a910-8740-4a3f-aafb-41a504f611ee"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:24:32.382426 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:24:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d6571497-c373-4674-8bdb-76292798e6fe x-openstack-request-id: req-d6571497-c373-4674-8bdb-76292798e6fe {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:24:32.383421 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e54682d5-964c-4bf7-b004-5718298ce580", "tag": "cd88a910-8740-4a3f-aafb-41a504f611ee", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:24:32.384224 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-d6571497-c373-4674-8bdb-76292798e6fe {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:24:32.385125 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e54682d5-964c-4bf7-b004-5718298ce580', 'tag': 'cd88a910-8740-4a3f-aafb-41a504f611ee', 'status': 'completed', 'code': 200}
May 31 16:24:32.492973 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-e9e82451-8f03-4ea5-a5b0-4feb72e61a10 None None] Set router 2bcd5afd-bdf4-472d-8a91-95997718441c gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:24:32.610504 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5cb09c3d-e700-4b6d-a0d8-7a44eea812ed req-089cf31d-b3ae-43ea-a270-ef16edc0c8ab tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 210 time: 0.0875030
May 31 16:24:32.633719 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c4f68a0-da1b-4de6-9661-7fc2fb52ac63 req-9a744688-3385-4cdf-8b22-c4b39c42c2da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:32.635190 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7c4f68a0-da1b-4de6-9661-7fc2fb52ac63 req-9a744688-3385-4cdf-8b22-c4b39c42c2da service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=a56002dfed61485aa4d9e237932e1abf&device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 1098 time: 0.2064836
May 31 16:24:32.807709 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c4f68a0-da1b-4de6-9661-7fc2fb52ac63 req-f1c53eaa-e088-4af0-94a8-7b62d815373b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:32.809366 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7c4f68a0-da1b-4de6-9661-7fc2fb52ac63 req-f1c53eaa-e088-4af0-94a8-7b62d815373b service neutron] 10.222.0.63 "GET /v2.0/networks?id=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 HTTP/1.1" status: 200  len: 911 time: 0.1667595
May 31 16:24:32.817935 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-9b4db2bf-342f-4777-a15f-ff81a5adb42f tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:32.818794 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-9b4db2bf-342f-4777-a15f-ff81a5adb42f tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Synchronizing usage tracker for tenant:8f633dd4e3b241db904e4505f98ebe62 on resource:network {{(pid=91763) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:24:32.840246 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-9b4db2bf-342f-4777-a15f-ff81a5adb42f tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Unset dirty status for tenant:8f633dd4e3b241db904e4505f98ebe62 on resource:network {{(pid=91763) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:24:32.842010 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-9b4db2bf-342f-4777-a15f-ff81a5adb42f tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.63 "GET /v2.0/networks?id=52011424-acd2-4b1b-9a3c-ebda39ad09da HTTP/1.1" status: 200  len: 814 time: 0.2089007
May 31 16:24:32.856000 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-329c7e56-a162-4c54-88d3-2ee82e40c872 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Request body: {'port': {'device_id': '899e9d5a-164d-478b-b9ff-812d895117bf', 'network_id': '52011424-acd2-4b1b-9a3c-ebda39ad09da', 'admin_state_up': True, 'tenant_id': '8f633dd4e3b241db904e4505f98ebe62'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:24:32.926762 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-e9e82451-8f03-4ea5-a5b0-4feb72e61a10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426132dc0>, [{'id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:24:01Z', 'updated_at': '2021-05-31T16:24:06Z', 'revision_number': 4, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'gw_port': {'id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:d3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 468, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:02Z', 'updated_at': '2021-05-31T16:24:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': 'db61d3b9-2e31-486b-8dd2-212bf03ec982', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'floating_ip_address': '172.27.0.98', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'port_id': 'cd88a910-8740-4a3f-aafb-41a504f611ee', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 476, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'mac_address': 'fa:16:3e:97:66:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e54682d5-964c-4bf7-b004-5718298ce580', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:24:10Z', 'updated_at': '2021-05-31T16:24:31Z', 'revision_number': 1, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '729c3966-0f99-4a7d-ab46-eadab5d24529', 'name': '', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'mac_address': 'fa:16:3e:23:3b:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_interface', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:04Z', 'updated_at': '2021-05-31T16:24:10Z', 'revision_number': 5, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'subnets': [{'id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:24:32.931658 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9e82451-8f03-4ea5-a5b0-4feb72e61a10 None None] Checking router: 2bcd5afd-bdf4-472d-8a91-95997718441c for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:24:32.941443 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7c4f68a0-da1b-4de6-9661-7fc2fb52ac63 req-551dcaff-a43b-4809-83d6-5718d3419c3d service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=cd88a910-8740-4a3f-aafb-41a504f611ee HTTP/1.1" status: 200  len: 998 time: 0.1232414
May 31 16:24:32.943576 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9e82451-8f03-4ea5-a5b0-4feb72e61a10 None None] Routers {'2bcd5afd-bdf4-472d-8a91-95997718441c'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:24:32.944221 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-e9e82451-8f03-4ea5-a5b0-4feb72e61a10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426132dc0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:24:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['2bcd5afd-bdf4-472d-8a91-95997718441c'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:24:33.027830 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c4f68a0-da1b-4de6-9661-7fc2fb52ac63 req-0e40b104-af3c-4663-86f4-93f8b3e63530 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:33.030496 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7c4f68a0-da1b-4de6-9661-7fc2fb52ac63 req-0e40b104-af3c-4663-86f4-93f8b3e63530 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=6489943b-1236-4d7c-80a7-58ef5aedf09d HTTP/1.1" status: 200  len: 849 time: 0.0811694
May 31 16:24:33.086959 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-329c7e56-a162-4c54-88d3-2ee82e40c872 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:24:33.113902 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-329c7e56-a162-4c54-88d3-2ee82e40c872 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:24:33.123921 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c4f68a0-da1b-4de6-9661-7fc2fb52ac63 req-cb7525da-5cbd-4366-8ae1-92f51d86e800 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:33.127198 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7c4f68a0-da1b-4de6-9661-7fc2fb52ac63 req-cb7525da-5cbd-4366-8ae1-92f51d86e800 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0879390
May 31 16:24:33.128838 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-329c7e56-a162-4c54-88d3-2ee82e40c872 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Made reservation on behalf of 8f633dd4e3b241db904e4505f98ebe62 for: {'port': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:24:33.133364 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-329c7e56-a162-4c54-88d3-2ee82e40c872 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:33.211299 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-e9e82451-8f03-4ea5-a5b0-4feb72e61a10 None None] Set router 2bcd5afd-bdf4-472d-8a91-95997718441c gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:24:33.295894 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7c4f68a0-da1b-4de6-9661-7fc2fb52ac63 req-135fb7a0-a353-4cba-8edf-aa0448827612 service neutron] 10.222.0.63 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1602242
May 31 16:24:33.347411 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-329c7e56-a162-4c54-88d3-2ee82e40c872 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Allocated IP 172.20.0.4 (52011424-acd2-4b1b-9a3c-ebda39ad09da/e9f7875f-b5af-4ade-af35-3604ed5d2f89/487b4be1-d7f8-41ea-9900-c3e035776735) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:24:33.487969 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7c4f68a0-da1b-4de6-9661-7fc2fb52ac63 req-98aa4a16-2899-40ea-aa00-451d378c5fd3 service neutron] 10.222.0.63 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1830173
May 31 16:24:33.707270 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-329c7e56-a162-4c54-88d3-2ee82e40c872 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:33.712830 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-e9e82451-8f03-4ea5-a5b0-4feb72e61a10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426132dc0>, [{'id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:24:01Z', 'updated_at': '2021-05-31T16:24:06Z', 'revision_number': 4, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'gw_port': {'id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:d3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 468, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:02Z', 'updated_at': '2021-05-31T16:24:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': 'db61d3b9-2e31-486b-8dd2-212bf03ec982', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'floating_ip_address': '172.27.0.98', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'port_id': 'cd88a910-8740-4a3f-aafb-41a504f611ee', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 476, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'mac_address': 'fa:16:3e:97:66:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e54682d5-964c-4bf7-b004-5718298ce580', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:24:10Z', 'updated_at': '2021-05-31T16:24:31Z', 'revision_number': 1, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '729c3966-0f99-4a7d-ab46-eadab5d24529', 'name': '', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'mac_address': 'fa:16:3e:23:3b:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_interface', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:04Z', 'updated_at': '2021-05-31T16:24:10Z', 'revision_number': 5, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'subnets': [{'id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:24:33.717070 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9e82451-8f03-4ea5-a5b0-4feb72e61a10 None None] The sync data for ids ['2bcd5afd-bdf4-472d-8a91-95997718441c'] in dv-cinder-793814-1-iscsi is: [{'id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:24:01Z', 'updated_at': '2021-05-31T16:24:06Z', 'revision_number': 4, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'gw_port': {'id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:d3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 468, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:02Z', 'updated_at': '2021-05-31T16:24:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': 'db61d3b9-2e31-486b-8dd2-212bf03ec982', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'floating_ip_address': '172.27.0.98', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'port_id': 'cd88a910-8740-4a3f-aafb-41a504f611ee', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 476, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'mac_address': 'fa:16:3e:97:66:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e54682d5-964c-4bf7-b004-5718298ce580', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:24:10Z', 'updated_at': '2021-05-31T16:24:31Z', 'revision_number': 1, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '729c3966-0f99-4a7d-ab46-eadab5d24529', 'name': '', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'mac_address': 'fa:16:3e:23:3b:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_interface', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:04Z', 'updated_at': '2021-05-31T16:24:10Z', 'revision_number': 5, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'subnets': [{'id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:24:33.744261 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-329c7e56-a162-4c54-88d3-2ee82e40c872 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:33.757062 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-3f5775cf-4354-43eb-a154-c3d885e025b0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:33.818182 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-329c7e56-a162-4c54-88d3-2ee82e40c872 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Network 52011424-acd2-4b1b-9a3c-ebda39ad09da is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:24:33.821798 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-329c7e56-a162-4c54-88d3-2ee82e40c872 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:24:33.824697 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-748f35ee-2bd3-46d7-b276-c38603c0a604 req-9c83117f-fcb4-4e01-b71e-a6ce58aacd53 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:33.826284 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-748f35ee-2bd3-46d7-b276-c38603c0a604 req-9c83117f-fcb4-4e01-b71e-a6ce58aacd53 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 931 time: 0.0897458
May 31 16:24:33.831374 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-329c7e56-a162-4c54-88d3-2ee82e40c872 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:24:33.875516 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-329c7e56-a162-4c54-88d3-2ee82e40c872 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Pushing event updated for resources: {'Port': ['ID=487b4be1-d7f8-41ea-9900-c3e035776735,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:33.881095 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-329c7e56-a162-4c54-88d3-2ee82e40c872 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:33.881630 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-748f35ee-2bd3-46d7-b276-c38603c0a604 req-333ad483-5a58-43ae-b782-974150d372cf tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0458982
May 31 16:24:33.904472 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-329c7e56-a162-4c54-88d3-2ee82e40c872 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:33.905020 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-329c7e56-a162-4c54-88d3-2ee82e40c872 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:33.945507 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96d0b618-ca43-4f74-9613-f2f44b158317 None None] New status for floating IP db61d3b9-2e31-486b-8dd2-212bf03ec982: ACTIVE {{(pid=91766) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 31 16:24:33.946094 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-329c7e56-a162-4c54-88d3-2ee82e40c872 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.63 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.0941701
May 31 16:24:35.006943 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-7109d13e-5460-4318-bb27-bd18cab1336b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:35.089890 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57af6840-6c0c-4516-b142-009075c8c943 req-bdc98731-d524-4a5b-a1e8-381e9f054ad5 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:35.091414 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-57af6840-6c0c-4516-b142-009075c8c943 req-bdc98731-d524-4a5b-a1e8-381e9f054ad5 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 931 time: 0.0848808
May 31 16:24:35.138044 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-57af6840-6c0c-4516-b142-009075c8c943 req-7d9a4858-7f2d-4074-ad58-07264494c9f5 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400174
May 31 16:24:36.327692 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b172789-c84f-47f3-acbd-8660182ad9a9 req-50a54197-a4ea-49c2-af9b-c61c89e7260d tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:36.329808 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3b172789-c84f-47f3-acbd-8660182ad9a9 req-50a54197-a4ea-49c2-af9b-c61c89e7260d tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 931 time: 0.0822601
May 31 16:24:36.372855 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3b172789-c84f-47f3-acbd-8660182ad9a9 req-7f108530-be94-4a57-b0ff-a422c2d6f98d tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0373983
May 31 16:24:36.741341 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Request body: {'port': {'device_id': '899e9d5a-164d-478b-b9ff-812d895117bf', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79381'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:24:36.857128 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:37.229642 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 487b4be1-d7f8-41ea-9900-c3e035776735 {{(pid=91763) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:24:37.238753 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Notify callbacks [] for port, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:37.258350 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.provisioning_blocks [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Transition to ACTIVE for port object 487b4be1-d7f8-41ea-9900-c3e035776735 will not be triggered until provisioned by entity L2. {{(pid=91763) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:24:37.263735 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14337082'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:37.269471 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-06d017de-dd85-4592-8993-704196324857 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:37.468777 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Pushing event updated for resources: {'Port': ['ID=487b4be1-d7f8-41ea-9900-c3e035776735,revision_number=2']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:37.505155 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.236s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:37.552559 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Attempting to bind port 487b4be1-d7f8-41ea-9900-c3e035776735 on host hv-cinder-79381 for vnic_type normal with profile  {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:24:37.552895 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Attempting to bind port 487b4be1-d7f8-41ea-9900-c3e035776735 by drivers openvswitch,hyperv on host hv-cinder-79381 at level 0 using segments [{'id': '54d58804-a1bf-4e3a-8d44-cdd8f5cc124a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 820, 'network_id': '52011424-acd2-4b1b-9a3c-ebda39ad09da'}] {{(pid=91763) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:24:37.553222 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Attempting to bind port 487b4be1-d7f8-41ea-9900-c3e035776735 on network 52011424-acd2-4b1b-9a3c-ebda39ad09da {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:24:37.557860 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Port 487b4be1-d7f8-41ea-9900-c3e035776735 on network 52011424-acd2-4b1b-9a3c-ebda39ad09da not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79381 {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 31 16:24:37.558184 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Attempting to bind port 487b4be1-d7f8-41ea-9900-c3e035776735 on network 52011424-acd2-4b1b-9a3c-ebda39ad09da {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:24:37.563355 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Checking agent: {'id': '4bed2638-4d91-4afb-bf81-aacca8584621', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79381', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'started_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 24, 20), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:24:37.564401 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Checking segment: {'id': '54d58804-a1bf-4e3a-8d44-cdd8f5cc124a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 820, 'network_id': '52011424-acd2-4b1b-9a3c-ebda39ad09da'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91763) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:24:37.564787 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Bound using segment: {'id': '54d58804-a1bf-4e3a-8d44-cdd8f5cc124a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 820, 'network_id': '52011424-acd2-4b1b-9a3c-ebda39ad09da'} {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:24:37.565221 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Bound port: 487b4be1-d7f8-41ea-9900-c3e035776735, host: hv-cinder-79381, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '54d58804-a1bf-4e3a-8d44-cdd8f5cc124a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 820, 'network_id': '52011424-acd2-4b1b-9a3c-ebda39ad09da'}}] {{(pid=91763) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:24:37.565581 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:37.567703 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8af25484-da16-40c9-a966-416f943be4e9 req-c7461f9a-fb15-4f6f-a67c-2eaeb7f1e583 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:37.569156 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8af25484-da16-40c9-a966-416f943be4e9 req-c7461f9a-fb15-4f6f-a67c-2eaeb7f1e583 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 943 time: 0.0864062
May 31 16:24:37.617637 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8af25484-da16-40c9-a966-416f943be4e9 req-e4b1e731-48a8-47a8-880c-f3d515ecbe55 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0423484
May 31 16:24:37.666031 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] For port 487b4be1-d7f8-41ea-9900-c3e035776735, host hv-cinder-79381, cleared binding levels {{(pid=91763) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:24:37.669275 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] For port 487b4be1-d7f8-41ea-9900-c3e035776735, host hv-cinder-79381, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=487b4be1-d7f8-41ea-9900-c3e035776735,segment=NetworkSegment(54d58804-a1bf-4e3a-8d44-cdd8f5cc124a),segment_id=54d58804-a1bf-4e3a-8d44-cdd8f5cc124a)] {{(pid=91763) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:24:37.674098 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14337082'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:37.678747 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:37.737137 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:37.737477 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:37.738867 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] 10.222.0.63 "PUT /v2.0/ports/487b4be1-d7f8-41ea-9900-c3e035776735 HTTP/1.1" status: 200  len: 1093 time: 1.0021017
May 31 16:24:37.739375 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '899e9d5a-164d-478b-b9ff-812d895117bf', 'tag': '487b4be1-d7f8-41ea-9900-c3e035776735'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:24:37.741698 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3671819b-e6a6-43fe-aa40-91d9ec90bbbf" -d '{"events": [{"name": "network-changed", "server_uuid": "899e9d5a-164d-478b-b9ff-812d895117bf", "tag": "487b4be1-d7f8-41ea-9900-c3e035776735"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:24:37.762244 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Pushing event updated for resources: {'Port': ['ID=487b4be1-d7f8-41ea-9900-c3e035776735,revision_number=3']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:37.765484 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:37.807236 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:24:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-62c16fa3-907b-4a10-84e3-0f778527b258 x-openstack-request-id: req-62c16fa3-907b-4a10-84e3-0f778527b258 {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:24:37.807563 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "899e9d5a-164d-478b-b9ff-812d895117bf", "tag": "487b4be1-d7f8-41ea-9900-c3e035776735", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:24:37.807848 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-62c16fa3-907b-4a10-84e3-0f778527b258 {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:24:37.808273 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '899e9d5a-164d-478b-b9ff-812d895117bf', 'tag': '487b4be1-d7f8-41ea-9900-c3e035776735', 'status': 'completed', 'code': 200}
May 31 16:24:37.889970 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-34f88822-11d1-484d-8879-9647816d6c83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:37.892182 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-34f88822-11d1-484d-8879-9647816d6c83 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=8f633dd4e3b241db904e4505f98ebe62&device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 1096 time: 0.0823808
May 31 16:24:37.894646 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:37.970297 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-d5593e80-ad86-4823-a961-b9d2d22454b3 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=487b4be1-d7f8-41ea-9900-c3e035776735 HTTP/1.1" status: 200  len: 217 time: 0.0646920
May 31 16:24:38.040048 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-14218c03-6ee7-4230-bca0-9273579d58c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:38.041512 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-14218c03-6ee7-4230-bca0-9273579d58c4 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=e9f7875f-b5af-4ade-af35-3604ed5d2f89 HTTP/1.1" status: 200  len: 854 time: 0.0645499
May 31 16:24:38.094304 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-3df50c19-ff55-4e1f-b73b-2c0305364dff service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=52011424-acd2-4b1b-9a3c-ebda39ad09da&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0428157
May 31 16:24:38.223906 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-76c86581-f6e4-4f8c-9da6-a0d1c28b8526 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:38.243492 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-24822d4f-841c-47e2-a36c-50f035e5cef8 service neutron] 10.222.0.63 "GET /v2.0/networks/52011424-acd2-4b1b-9a3c-ebda39ad09da?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1410401
May 31 16:24:38.483615 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-3d7807be-8cc7-4363-9d6a-f4f42b13504f req-aef6f787-9451-4846-89ae-fd3d6a16075e service neutron] 10.222.0.63 "GET /v2.0/networks/52011424-acd2-4b1b-9a3c-ebda39ad09da?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2243507
May 31 16:24:38.611542 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3671819b-e6a6-43fe-aa40-91d9ec90bbbf req-bcd70d16-f2a6-4802-9d81-54d64e121de1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:38.613102 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-3671819b-e6a6-43fe-aa40-91d9ec90bbbf req-bcd70d16-f2a6-4802-9d81-54d64e121de1 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=8f633dd4e3b241db904e4505f98ebe62&device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 1096 time: 0.0772910
May 31 16:24:38.810787 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d3b0c08-dbc0-494e-b358-776f52d5aedd req-68ef6340-9453-4482-848f-a7deba63e4ae tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:38.812273 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7d3b0c08-dbc0-494e-b358-776f52d5aedd req-68ef6340-9453-4482-848f-a7deba63e4ae tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 943 time: 0.0826843
May 31 16:24:38.861883 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7d3b0c08-dbc0-494e-b358-776f52d5aedd req-1d0976c9-2853-4ca7-9481-2d8ff0fd8617 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0426829
May 31 16:24:39.153080 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:40.060001 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58101d13-ba77-45f3-bb4d-e7404d842cdb req-75d55a6a-17ab-48c2-9dea-d3ba4b8fa5af tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:40.061508 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-58101d13-ba77-45f3-bb4d-e7404d842cdb req-75d55a6a-17ab-48c2-9dea-d3ba4b8fa5af tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 943 time: 0.0885170
May 31 16:24:40.109169 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-58101d13-ba77-45f3-bb4d-e7404d842cdb req-0db6b307-15f2-44ea-b1da-1f58bc9c90c9 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0416849
May 31 16:24:40.857427 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:41.301250 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56ec50fa-e8da-445a-b486-9eb43ae9d8b0 req-bf3075af-b6a7-4718-a1d3-be682e536d68 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:41.302810 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-56ec50fa-e8da-445a-b486-9eb43ae9d8b0 req-bf3075af-b6a7-4718-a1d3-be682e536d68 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 943 time: 0.0831397
May 31 16:24:41.438982 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-56ec50fa-e8da-445a-b486-9eb43ae9d8b0 req-8cad8dd1-6b2c-43cb-b6ef-491a575611b6 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1297076
May 31 16:24:41.860854 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3671819b-e6a6-43fe-aa40-91d9ec90bbbf req-9ad43386-ea2f-4652-9c54-fbd6a0e3c1f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:41.862341 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-3671819b-e6a6-43fe-aa40-91d9ec90bbbf req-9ad43386-ea2f-4652-9c54-fbd6a0e3c1f2 service neutron] 10.222.0.63 "GET /v2.0/networks?id=52011424-acd2-4b1b-9a3c-ebda39ad09da HTTP/1.1" status: 200  len: 915 time: 0.1328638
May 31 16:24:41.931422 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-3671819b-e6a6-43fe-aa40-91d9ec90bbbf req-a9c6ca01-759e-46ff-bbb3-66f840024f2d service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=487b4be1-d7f8-41ea-9900-c3e035776735 HTTP/1.1" status: 200  len: 217 time: 0.0592775
May 31 16:24:42.006121 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3671819b-e6a6-43fe-aa40-91d9ec90bbbf req-abc87d99-2f76-48be-b3f7-6a6b8a2cbcc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:42.007912 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-3671819b-e6a6-43fe-aa40-91d9ec90bbbf req-abc87d99-2f76-48be-b3f7-6a6b8a2cbcc4 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=e9f7875f-b5af-4ade-af35-3604ed5d2f89 HTTP/1.1" status: 200  len: 854 time: 0.0637670
May 31 16:24:42.059992 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-3671819b-e6a6-43fe-aa40-91d9ec90bbbf req-16edf680-044b-4a11-b312-04e341f88308 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=52011424-acd2-4b1b-9a3c-ebda39ad09da&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0423338
May 31 16:24:42.199287 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-3671819b-e6a6-43fe-aa40-91d9ec90bbbf req-f3fe0f03-6903-402f-aa97-d0efabb23b14 service neutron] 10.222.0.63 "GET /v2.0/networks/52011424-acd2-4b1b-9a3c-ebda39ad09da?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1313591
May 31 16:24:42.344075 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-3671819b-e6a6-43fe-aa40-91d9ec90bbbf req-5b0a317c-d2f2-418b-ba44-611486be3832 service neutron] 10.222.0.63 "GET /v2.0/networks/52011424-acd2-4b1b-9a3c-ebda39ad09da?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1329803
May 31 16:24:42.627614 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc806935-8989-41b1-a44f-4ab15c1c960f req-687b7fdd-a3ef-4ba0-80c3-e015b7aa5927 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:42.629138 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bc806935-8989-41b1-a44f-4ab15c1c960f req-687b7fdd-a3ef-4ba0-80c3-e015b7aa5927 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 943 time: 0.0844519
May 31 16:24:42.681543 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bc806935-8989-41b1-a44f-4ab15c1c960f req-8f5b9c05-e480-46a4-b993-a747eae040e3 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0464504
May 31 16:24:43.895350 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9b88a31-d1a8-4223-9237-ac042cff1d08 req-9be63e55-b44b-4a8a-b099-0f47a708d35e tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:43.896851 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c9b88a31-d1a8-4223-9237-ac042cff1d08 req-9be63e55-b44b-4a8a-b099-0f47a708d35e tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 943 time: 0.0902569
May 31 16:24:43.945244 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c9b88a31-d1a8-4223-9237-ac042cff1d08 req-cde6f79e-9b85-4dfb-8e49-ffb5391189fd tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425870
May 31 16:24:45.152177 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26aeed9a-0405-48fc-a992-81e5320ad569 req-4c203ba0-b2d6-4f19-9ab7-8844edfb9212 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:45.153648 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-26aeed9a-0405-48fc-a992-81e5320ad569 req-4c203ba0-b2d6-4f19-9ab7-8844edfb9212 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 943 time: 0.0879726
May 31 16:24:45.203008 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-26aeed9a-0405-48fc-a992-81e5320ad569 req-72809c63-4b0a-40ad-8cb2-daf1abe72738 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0431209
May 31 16:24:45.607137 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 487b4be1-d7f8-41ea-9900-c3e035776735 details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:24:45.746810 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 487b4be1-d7f8-41ea-9900-c3e035776735, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=487b4be1-d7f8-41ea-9900-c3e035776735,segment=NetworkSegment(54d58804-a1bf-4e3a-8d44-cdd8f5cc124a),segment_id=54d58804-a1bf-4e3a-8d44-cdd8f5cc124a)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:24:45.761296 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': '487b4be1-d7f8-41ea-9900-c3e035776735', 'network_id': '52011424-acd2-4b1b-9a3c-ebda39ad09da', 'port_id': '487b4be1-d7f8-41ea-9900-c3e035776735', 'mac_address': 'fa:16:3e:f3:51:f4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 820, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e9f7875f-b5af-4ade-af35-3604ed5d2f89', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:24:45.822565 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:45.839817 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 487b4be1-d7f8-41ea-9900-c3e035776735 {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:24:45.855985 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 487b4be1-d7f8-41ea-9900-c3e035776735, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=487b4be1-d7f8-41ea-9900-c3e035776735,segment=NetworkSegment(54d58804-a1bf-4e3a-8d44-cdd8f5cc124a),segment_id=54d58804-a1bf-4e3a-8d44-cdd8f5cc124a)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:24:45.859949 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:45.862323 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:45.928292 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=487b4be1-d7f8-41ea-9900-c3e035776735,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:45.935665 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:45.936024 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:45.936366 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:45.936702 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:45.937037 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:45.937367 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:45.937725 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:45.938054 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:45.938379 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:45.938702 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:45.939630 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:45.940059 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:24:45.944242 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:46.393702 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98fc2685-5383-4a73-9d57-36c48be35d24 req-c3852401-ae43-40ff-b936-10a72a97283f tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:46.395203 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-98fc2685-5383-4a73-9d57-36c48be35d24 req-c3852401-ae43-40ff-b936-10a72a97283f tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 944 time: 0.0833786
May 31 16:24:46.445796 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-98fc2685-5383-4a73-9d57-36c48be35d24 req-dc25f1f1-dfd4-4e4b-8779-4b35654f8099 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0448651
May 31 16:24:47.647481 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-718495ff-cfef-487a-855e-10d6ce8ba9be req-a8bf9774-2200-45cf-afa5-298123d43b35 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:47.648983 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-718495ff-cfef-487a-855e-10d6ce8ba9be req-a8bf9774-2200-45cf-afa5-298123d43b35 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 944 time: 0.0925574
May 31 16:24:47.698787 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-718495ff-cfef-487a-855e-10d6ce8ba9be req-5beeb7c1-bc3f-4c7d-949e-288c5786f91c tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429966
May 31 16:24:47.956579 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['487b4be1-d7f8-41ea-9900-c3e035776735'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:24:48.917335 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85c1f67c-e18b-4cf9-86fa-2d30b7fc47ec req-47a4f63b-63aa-49ad-9188-7c2b009da10d tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:48.918786 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-85c1f67c-e18b-4cf9-86fa-2d30b7fc47ec req-47a4f63b-63aa-49ad-9188-7c2b009da10d tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 944 time: 0.0835078
May 31 16:24:48.965577 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-85c1f67c-e18b-4cf9-86fa-2d30b7fc47ec req-9795b470-8bc2-4a4c-b535-14ef1f69840a tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408275
May 31 16:24:49.604537 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 487b4be1-d7f8-41ea-9900-c3e035776735 up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:24:49.666287 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:49.687778 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning for port 487b4be1-d7f8-41ea-9900-c3e035776735 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:24:49.694093 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port 487b4be1-d7f8-41ea-9900-c3e035776735 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:24:49.694093 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:49.834079 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:49.871968 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '899e9d5a-164d-478b-b9ff-812d895117bf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '487b4be1-d7f8-41ea-9900-c3e035776735'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:24:49.874490 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d70900f4-5723-4370-865a-e08479b6ff42" -d '{"events": [{"server_uuid": "899e9d5a-164d-478b-b9ff-812d895117bf", "name": "network-vif-plugged", "status": "completed", "tag": "487b4be1-d7f8-41ea-9900-c3e035776735"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:24:49.882483 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 487b4be1-d7f8-41ea-9900-c3e035776735, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=487b4be1-d7f8-41ea-9900-c3e035776735,segment=NetworkSegment(54d58804-a1bf-4e3a-8d44-cdd8f5cc124a),segment_id=54d58804-a1bf-4e3a-8d44-cdd8f5cc124a)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:24:49.886441 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:49.888624 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:49.916919 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f31b5e98-bacc-4349-8bd8-7087cc51c958 req-3d67f969-f136-490d-b2bb-856538370753 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:49.918389 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f31b5e98-bacc-4349-8bd8-7087cc51c958 req-3d67f969-f136-490d-b2bb-856538370753 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 947 time: 0.0976694
May 31 16:24:49.964467 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:24:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-93afb114-e911-48fd-b356-e985e0486b5d x-openstack-request-id: req-93afb114-e911-48fd-b356-e985e0486b5d {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:24:49.964870 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "899e9d5a-164d-478b-b9ff-812d895117bf", "name": "network-vif-plugged", "status": "completed", "tag": "487b4be1-d7f8-41ea-9900-c3e035776735", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:24:49.965228 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-93afb114-e911-48fd-b356-e985e0486b5d {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:24:49.965745 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '899e9d5a-164d-478b-b9ff-812d895117bf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '487b4be1-d7f8-41ea-9900-c3e035776735', 'code': 200}
May 31 16:24:49.978400 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f31b5e98-bacc-4349-8bd8-7087cc51c958 req-7d4df14e-cfd2-4795-b9ee-0e6540209f00 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0528791
May 31 16:24:49.986897 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=487b4be1-d7f8-41ea-9900-c3e035776735,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:49.996175 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:50.199487 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0b451de-ad2c-4d03-90f9-832f95a613b1 req-01b5fcba-3572-4155-a2f4-3918f12c8965 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:50.200908 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e0b451de-ad2c-4d03-90f9-832f95a613b1 req-01b5fcba-3572-4155-a2f4-3918f12c8965 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 945 time: 0.0901060
May 31 16:24:50.245012 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-730a2cab-8c1f-46b7-bb6f-25ba77209531 req-583ae7cd-c25a-42cb-b440-15fdcb8b18e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:50.246686 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-730a2cab-8c1f-46b7-bb6f-25ba77209531 req-583ae7cd-c25a-42cb-b440-15fdcb8b18e2 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 1098 time: 0.0861387
May 31 16:24:50.255870 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e0b451de-ad2c-4d03-90f9-832f95a613b1 req-f6939912-d0d7-4c89-b88d-172ff0a22a33 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0465713
May 31 16:24:50.293098 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-730a2cab-8c1f-46b7-bb6f-25ba77209531 req-6f692843-eb98-4f88-948d-d2f62536089c service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0347412
May 31 16:24:51.177729 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2f1bf57-bf66-429b-b488-a49f2456197b req-782abcf0-2988-48ae-8756-775b3f18f8b7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:51.179311 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a2f1bf57-bf66-429b-b488-a49f2456197b req-782abcf0-2988-48ae-8756-775b3f18f8b7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 947 time: 0.0907700
May 31 16:24:51.230241 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a2f1bf57-bf66-429b-b488-a49f2456197b req-12f579b8-8d03-4b64-88cc-fece89543b4f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0452390
May 31 16:24:51.454116 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-446ecfee-6cdd-4782-8571-e8b9d4f1a30d req-8174ed8c-c5f4-4bcd-a24b-28570b2e9cb4 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:51.456545 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-446ecfee-6cdd-4782-8571-e8b9d4f1a30d req-8174ed8c-c5f4-4bcd-a24b-28570b2e9cb4 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 945 time: 0.0929980
May 31 16:24:51.506156 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-446ecfee-6cdd-4782-8571-e8b9d4f1a30d req-a9041a77-8b39-4bb4-99c8-bda24c53a01b tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0412540
May 31 16:24:52.423076 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dd2df25-ce46-42a5-8103-2770d90e64dd req-392774dc-6f42-47f0-aa36-43559a7b45a1 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:52.424540 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2dd2df25-ce46-42a5-8103-2770d90e64dd req-392774dc-6f42-47f0-aa36-43559a7b45a1 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 947 time: 0.0832992
May 31 16:24:52.469894 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2dd2df25-ce46-42a5-8103-2770d90e64dd req-8e9c4a0b-0fc7-4f10-a73a-803a7e1fd1b5 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0395703
May 31 16:24:52.699293 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37a98b92-86eb-46bc-b806-a8163ebdd5e2 req-a38ab4f4-33f4-4064-85d2-7099aa316b3d tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:52.700740 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-37a98b92-86eb-46bc-b806-a8163ebdd5e2 req-a38ab4f4-33f4-4064-85d2-7099aa316b3d tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 945 time: 0.0844777
May 31 16:24:52.747254 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-37a98b92-86eb-46bc-b806-a8163ebdd5e2 req-9d1401af-4886-45af-90d6-648c6b3ab492 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400138
May 31 16:24:53.659912 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a187e1e-65be-49fa-9d77-5154dde02ee1 req-5a3242a2-36be-4e34-9564-0236faa11872 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:53.661362 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4a187e1e-65be-49fa-9d77-5154dde02ee1 req-5a3242a2-36be-4e34-9564-0236faa11872 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 947 time: 0.0812566
May 31 16:24:53.709637 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4a187e1e-65be-49fa-9d77-5154dde02ee1 req-480e00f3-f580-47c2-8c86-6fb943e91cc9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0425215
May 31 16:24:53.936487 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e44edf2-7cb5-43c7-b301-c9beab132d70 req-3e379dd0-70d5-402d-98d0-ea44fa005669 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:53.937941 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5e44edf2-7cb5-43c7-b301-c9beab132d70 req-3e379dd0-70d5-402d-98d0-ea44fa005669 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 945 time: 0.0818560
May 31 16:24:53.983945 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5e44edf2-7cb5-43c7-b301-c9beab132d70 req-327d4b42-3632-4ea2-8bd8-f6c5ded03e3a tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397134
May 31 16:24:54.167856 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:24:54.914732 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48bdedd5-b11a-41a5-85ba-40292fd0168e req-fcfefbab-147e-4b42-8e72-d6c5b0630c46 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:54.916263 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-48bdedd5-b11a-41a5-85ba-40292fd0168e req-fcfefbab-147e-4b42-8e72-d6c5b0630c46 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 947 time: 0.0895081
May 31 16:24:54.963215 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-48bdedd5-b11a-41a5-85ba-40292fd0168e req-83550d37-953e-408f-9295-d2a9023f8c36 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=d7103354-0273-4035-bb29-eefdd75b99c9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0412254
May 31 16:24:55.178118 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccdca828-ccc9-46bb-9b15-2a4adfff3219 req-a20cf159-6441-41bf-8c34-bebf2b343855 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:55.179539 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ccdca828-ccc9-46bb-9b15-2a4adfff3219 req-a20cf159-6441-41bf-8c34-bebf2b343855 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 945 time: 0.0860953
May 31 16:24:55.206008 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fac39d0f-8b8e-4ca4-be0a-b573448eb7f2 req-cf69b31d-bb2c-4bf9-8842-c63fe4f06e70 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:24:55.207731 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-fac39d0f-8b8e-4ca4-be0a-b573448eb7f2 req-cf69b31d-bb2c-4bf9-8842-c63fe4f06e70 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.63 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 947 time: 0.0820889
May 31 16:24:55.225646 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ccdca828-ccc9-46bb-9b15-2a4adfff3219 req-f837114d-e0f0-4654-bf15-312dd48290cd tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403543
May 31 16:24:55.354682 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-fac39d0f-8b8e-4ca4-be0a-b573448eb7f2 req-196d4d8d-a951-4090-8381-fdacb1a10ebc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Deleting port 8cf870c7-bdf1-490f-adfa-61e27997bc91 {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:24:55.355042 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-fac39d0f-8b8e-4ca4-be0a-b573448eb7f2 req-196d4d8d-a951-4090-8381-fdacb1a10ebc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:55.496402 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-fac39d0f-8b8e-4ca4-be0a-b573448eb7f2 req-196d4d8d-a951-4090-8381-fdacb1a10ebc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] For port 8cf870c7-bdf1-490f-adfa-61e27997bc91, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=8cf870c7-bdf1-490f-adfa-61e27997bc91,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:24:55.496868 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-fac39d0f-8b8e-4ca4-be0a-b573448eb7f2 req-196d4d8d-a951-4090-8381-fdacb1a10ebc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:55.827489 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-fac39d0f-8b8e-4ca4-be0a-b573448eb7f2 req-196d4d8d-a951-4090-8381-fdacb1a10ebc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:55.829174 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-fac39d0f-8b8e-4ca4-be0a-b573448eb7f2 req-196d4d8d-a951-4090-8381-fdacb1a10ebc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16621821'] for floatingip, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:55.829174 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.l3_db [req-fac39d0f-8b8e-4ca4-be0a-b573448eb7f2 req-196d4d8d-a951-4090-8381-fdacb1a10ebc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Floating IP fce714cf-2d56-4577-90b0-4e3cd0299039 disassociated. External IP: 172.27.0.136, port: 8cf870c7-bdf1-490f-adfa-61e27997bc91.
May 31 16:24:55.829174 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-fac39d0f-8b8e-4ca4-be0a-b573448eb7f2 req-196d4d8d-a951-4090-8381-fdacb1a10ebc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Calling delete_port for 8cf870c7-bdf1-490f-adfa-61e27997bc91 owned by compute:nova {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:24:56.075169 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-fac39d0f-8b8e-4ca4-be0a-b573448eb7f2 req-196d4d8d-a951-4090-8381-fdacb1a10ebc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:56.084430 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-fef1db7d-855c-4979-89d5-347f7d1ac3de tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:24:56.131720 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-337f582e-aae2-4b36-9822-554b1d233f88 req-ffa3c254-2e66-451d-8d95-19db288e5830 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 210 time: 0.0484295
May 31 16:24:56.134748 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-196d4d8d-a951-4090-8381-fdacb1a10ebc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Pushing event deleted for resources: {'Port': ['ID=8cf870c7-bdf1-490f-adfa-61e27997bc91,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:24:56.137613 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-196d4d8d-a951-4090-8381-fdacb1a10ebc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:24:56.327349 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [req-fac39d0f-8b8e-4ca4-be0a-b573448eb7f2 req-196d4d8d-a951-4090-8381-fdacb1a10ebc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Router 8471b167-8540-4806-9932-e05fcb75a12b has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91763) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:24:56.518925 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-fac39d0f-8b8e-4ca4-be0a-b573448eb7f2 req-196d4d8d-a951-4090-8381-fdacb1a10ebc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:24:56.528652 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-203238b0-4c4d-49e9-a550-c04f5aef8d21 None None] Sync routers for ids ['8471b167-8540-4806-9932-e05fcb75a12b'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:24:56.539608 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-203238b0-4c4d-49e9-a550-c04f5aef8d21 None None] Routers {'8471b167-8540-4806-9932-e05fcb75a12b'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:24:56.540250 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-203238b0-4c4d-49e9-a550-c04f5aef8d21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426663fd0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:24:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['8471b167-8540-4806-9932-e05fcb75a12b'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:24:56.596011 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [req-fac39d0f-8b8e-4ca4-be0a-b573448eb7f2 req-196d4d8d-a951-4090-8381-fdacb1a10ebc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] No DVR routers for this DVR port 8cf870c7-bdf1-490f-adfa-61e27997bc91 on host hv-cinder-79381 {{(pid=91763) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:24:56.598070 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-fac39d0f-8b8e-4ca4-be0a-b573448eb7f2 req-196d4d8d-a951-4090-8381-fdacb1a10ebc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:24:56.600713 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '236769ac-e375-4497-9fe7-7425ccc79d09', 'name': 'network-vif-deleted', 'tag': '8cf870c7-bdf1-490f-adfa-61e27997bc91'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:24:56.602990 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-933bc2d6-8647-4ea6-98d8-359f0affcf29" -d '{"events": [{"server_uuid": "236769ac-e375-4497-9fe7-7425ccc79d09", "name": "network-vif-deleted", "tag": "8cf870c7-bdf1-490f-adfa-61e27997bc91"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:24:56.617202 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-fac39d0f-8b8e-4ca4-be0a-b573448eb7f2 req-196d4d8d-a951-4090-8381-fdacb1a10ebc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.63 "DELETE /v2.0/ports/8cf870c7-bdf1-490f-adfa-61e27997bc91 HTTP/1.1" status: 204  len: 173 time: 1.4036961
May 31 16:24:56.660192 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:24:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e0d4b585-12ae-4fc4-a604-22d6d4b7de0f x-openstack-request-id: req-e0d4b585-12ae-4fc4-a604-22d6d4b7de0f {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:24:56.660590 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "236769ac-e375-4497-9fe7-7425ccc79d09", "name": "network-vif-deleted", "tag": "8cf870c7-bdf1-490f-adfa-61e27997bc91", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:24:56.660942 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-e0d4b585-12ae-4fc4-a604-22d6d4b7de0f {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:24:56.661432 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '236769ac-e375-4497-9fe7-7425ccc79d09', 'name': 'network-vif-deleted', 'tag': '8cf870c7-bdf1-490f-adfa-61e27997bc91', 'status': 'completed', 'code': 200}
May 31 16:24:56.726871 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-203238b0-4c4d-49e9-a550-c04f5aef8d21 None None] Set router 8471b167-8540-4806-9932-e05fcb75a12b gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:24:57.081227 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-203238b0-4c4d-49e9-a550-c04f5aef8d21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426663fd0>, [{'id': '8471b167-8540-4806-9932-e05fcb75a12b', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:55Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '12203182731d4a61acb7fc5914aef425', 'gw_port': {'id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:83:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:19:56Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': 'db126eb4-e252-4765-86f1-09d3f20549df', 'name': '', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'mac_address': 'fa:16:3e:63:bd:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:04Z', 'updated_at': '2021-05-31T16:20:20Z', 'revision_number': 5, 'project_id': '12203182731d4a61acb7fc5914aef425', 'subnets': [{'id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:24:57.085397 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-203238b0-4c4d-49e9-a550-c04f5aef8d21 None None] Checking router: 8471b167-8540-4806-9932-e05fcb75a12b for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:24:57.096212 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-203238b0-4c4d-49e9-a550-c04f5aef8d21 None None] Routers {'8471b167-8540-4806-9932-e05fcb75a12b'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:24:57.096975 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-203238b0-4c4d-49e9-a550-c04f5aef8d21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426663fd0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:24:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['8471b167-8540-4806-9932-e05fcb75a12b'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:24:57.285770 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-203238b0-4c4d-49e9-a550-c04f5aef8d21 None None] Set router 8471b167-8540-4806-9932-e05fcb75a12b gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:24:57.295043 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7c10aecb-89e9-4e93-9ca4-985782a79561 req-631153cb-9928-452d-b7a3-56866c19e3b1 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 210 time: 0.0457118
May 31 16:24:57.608724 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-203238b0-4c4d-49e9-a550-c04f5aef8d21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426663fd0>, [{'id': '8471b167-8540-4806-9932-e05fcb75a12b', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:55Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '12203182731d4a61acb7fc5914aef425', 'gw_port': {'id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:83:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:19:56Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': 'db126eb4-e252-4765-86f1-09d3f20549df', 'name': '', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'mac_address': 'fa:16:3e:63:bd:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:04Z', 'updated_at': '2021-05-31T16:20:20Z', 'revision_number': 5, 'project_id': '12203182731d4a61acb7fc5914aef425', 'subnets': [{'id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:24:57.613621 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-203238b0-4c4d-49e9-a550-c04f5aef8d21 None None] The sync data for ids ['8471b167-8540-4806-9932-e05fcb75a12b'] in dv-cinder-793814-1-iscsi is: [{'id': '8471b167-8540-4806-9932-e05fcb75a12b', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:55Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '12203182731d4a61acb7fc5914aef425', 'gw_port': {'id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:83:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:19:56Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': 'db126eb4-e252-4765-86f1-09d3f20549df', 'name': '', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'mac_address': 'fa:16:3e:63:bd:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:04Z', 'updated_at': '2021-05-31T16:20:20Z', 'revision_number': 5, 'project_id': '12203182731d4a61acb7fc5914aef425', 'subnets': [{'id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:24:57.842215 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62ffa66e-d812-4c2c-a73c-fe910419e6ee None None] New status for floating IP fce714cf-2d56-4577-90b0-4e3cd0299039: DOWN {{(pid=91766) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 31 16:24:58.634954 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-62752542-d4b7-4a32-9efb-153b6da6a36e req-2a4c62fb-1fd3-44a7-92d7-4d7e862953e4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 210 time: 0.2223587
May 31 16:24:59.875877 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-23e3f5ef-226c-4c8b-ab94-3f9324e05d7c req-9a294284-974d-40bf-b590-fedbae6a57a4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=236769ac-e375-4497-9fe7-7425ccc79d09 HTTP/1.1" status: 200  len: 210 time: 0.1282916
May 31 16:25:01.001837 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 35192) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:01.067149 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5f4034a9-0786-45f7-94d9-d616d88105f0 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:01.095276 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5f4034a9-0786-45f7-94d9-d616d88105f0 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:01.149751 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5f4034a9-0786-45f7-94d9-d616d88105f0 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:01.153652 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-a707ea85-90a5-44e3-94d3-2b862e3e0909 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:01.168940 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f4034a9-0786-45f7-94d9-d616d88105f0 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d7103354-0273-4035-bb29-eefdd75b99c9,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:01.172138 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-5f4034a9-0786-45f7-94d9-d616d88105f0 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:01.181044 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5f4034a9-0786-45f7-94d9-d616d88105f0 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:01.184587 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-5f4034a9-0786-45f7-94d9-d616d88105f0 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "DELETE /v2.0/security-groups/d7103354-0273-4035-bb29-eefdd75b99c9 HTTP/1.1" status: 204  len: 168 time: 0.1779480
May 31 16:25:01.184855 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 35196) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:01.201682 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.api.v2.resource [None req-4694c909-5f0d-4757-904f-d6ce8bdb9c1d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] show failed (client error): The resource could not be found.
May 31 16:25:01.202659 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-4694c909-5f0d-4757-904f-d6ce8bdb9c1d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups/d7103354-0273-4035-bb29-eefdd75b99c9 HTTP/1.1" status: 404  len: 347 time: 0.0168896
May 31 16:25:01.205408 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 35200) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:01.421005 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-1acdb7ea-184a-4c6b-bc3e-ff5f2115dedd tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Deleting port da864462-bb4e-4161-b635-28d836ab96b9 {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:25:01.421257 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-1acdb7ea-184a-4c6b-bc3e-ff5f2115dedd tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:01.538473 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-1acdb7ea-184a-4c6b-bc3e-ff5f2115dedd tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:01.538794 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-1acdb7ea-184a-4c6b-bc3e-ff5f2115dedd tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:01.654582 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 8cf870c7-bdf1-490f-adfa-61e27997bc91 no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:25:01.660357 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-1acdb7ea-184a-4c6b-bc3e-ff5f2115dedd tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Calling delete_port for da864462-bb4e-4161-b635-28d836ab96b9 owned by network:floatingip {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:25:01.692733 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] No Port match for: 8cf870c7-bdf1-490f-adfa-61e27997bc91 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:25:01.693185 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 8cf870c7-bdf1-490f-adfa-61e27997bc91 not bound to the agent host hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:25:01.787537 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-1acdb7ea-184a-4c6b-bc3e-ff5f2115dedd tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:01.792589 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:01.839891 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1acdb7ea-184a-4c6b-bc3e-ff5f2115dedd tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Pushing event deleted for resources: {'Port': ['ID=da864462-bb4e-4161-b635-28d836ab96b9,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:01.842717 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-1acdb7ea-184a-4c6b-bc3e-ff5f2115dedd tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:01.950684 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-1acdb7ea-184a-4c6b-bc3e-ff5f2115dedd tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for floatingip, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:01.967334 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-1acdb7ea-184a-4c6b-bc3e-ff5f2115dedd tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for floatingip, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:01.970672 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-1acdb7ea-184a-4c6b-bc3e-ff5f2115dedd tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "DELETE /v2.0/floatingips/fce714cf-2d56-4577-90b0-4e3cd0299039 HTTP/1.1" status: 204  len: 168 time: 0.7621021
May 31 16:25:02.412825 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 35242) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:02.418099 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-af9fec02-207b-4185-af88-9d30606cf08f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Request body: {'security_group': {'name': 'tempest-securitygroup--473631203', 'description': 'tempest-description--298952408'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:25:02.423695 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-af9fec02-207b-4185-af88-9d30606cf08f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:25:02.428491 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-af9fec02-207b-4185-af88-9d30606cf08f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Usage tracker for resource:security_group and tenant:12203182731d4a61acb7fc5914aef425 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:25:02.431492 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-af9fec02-207b-4185-af88-9d30606cf08f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:25:02.438292 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-af9fec02-207b-4185-af88-9d30606cf08f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:25:02.449519 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-af9fec02-207b-4185-af88-9d30606cf08f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:02.470401 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-af9fec02-207b-4185-af88-9d30606cf08f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:25:02.474481 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-af9fec02-207b-4185-af88-9d30606cf08f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Usage tracker for resource:security_group_rule and tenant:12203182731d4a61acb7fc5914aef425 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:25:02.477296 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-af9fec02-207b-4185-af88-9d30606cf08f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:25:02.483002 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-af9fec02-207b-4185-af88-9d30606cf08f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:25:02.555243 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-af9fec02-207b-4185-af88-9d30606cf08f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:02.558876 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-af9fec02-207b-4185-af88-9d30606cf08f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:02.563718 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:02.604610 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af9fec02-207b-4185-af88-9d30606cf08f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8fbc8cfd-84c0-4533-a8cc-20e7833b04de,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:02.607298 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-af9fec02-207b-4185-af88-9d30606cf08f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:02.608474 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-af9fec02-207b-4185-af88-9d30606cf08f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1778 time: 0.1946554
May 31 16:25:02.609341 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-af9fec02-207b-4185-af88-9d30606cf08f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:02.611453 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 35246) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:02.616974 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-3abe0d7f-cb89-4273-8f85-5636e71e99d9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Request body: {'security_group_rule': {'security_group_id': '8fbc8cfd-84c0-4533-a8cc-20e7833b04de', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:25:02.622720 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-3abe0d7f-cb89-4273-8f85-5636e71e99d9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:25:02.626829 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-3abe0d7f-cb89-4273-8f85-5636e71e99d9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Usage tracker for resource:security_group_rule and tenant:12203182731d4a61acb7fc5914aef425 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:25:02.630059 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-3abe0d7f-cb89-4273-8f85-5636e71e99d9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:25:02.635766 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-3abe0d7f-cb89-4273-8f85-5636e71e99d9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:25:02.654557 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3abe0d7f-cb89-4273-8f85-5636e71e99d9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:02.714521 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3abe0d7f-cb89-4273-8f85-5636e71e99d9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:02.718221 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3abe0d7f-cb89-4273-8f85-5636e71e99d9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:02.720164 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:02.743458 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3abe0d7f-cb89-4273-8f85-5636e71e99d9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=98ed34c6-6d76-4f5a-af13-305028f5582c,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:02.747961 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-3abe0d7f-cb89-4273-8f85-5636e71e99d9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:02.752684 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3abe0d7f-cb89-4273-8f85-5636e71e99d9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:02.754189 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-3abe0d7f-cb89-4273-8f85-5636e71e99d9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1412821
May 31 16:25:02.756881 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 35250) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:02.761949 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-3da599b5-8b50-4a82-8973-7e54433bd5e8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Request body: {'security_group_rule': {'security_group_id': '8fbc8cfd-84c0-4533-a8cc-20e7833b04de', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:25:02.767774 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-3da599b5-8b50-4a82-8973-7e54433bd5e8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:25:02.771763 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-3da599b5-8b50-4a82-8973-7e54433bd5e8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Usage tracker for resource:security_group_rule and tenant:12203182731d4a61acb7fc5914aef425 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:25:02.775182 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-3da599b5-8b50-4a82-8973-7e54433bd5e8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:25:02.780842 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-3da599b5-8b50-4a82-8973-7e54433bd5e8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:25:02.796900 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3da599b5-8b50-4a82-8973-7e54433bd5e8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:02.858808 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3da599b5-8b50-4a82-8973-7e54433bd5e8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:02.863107 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3da599b5-8b50-4a82-8973-7e54433bd5e8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:02.869248 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c565c56b-5d53-4438-9b1b-ba50009f6f85 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:02.888228 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3da599b5-8b50-4a82-8973-7e54433bd5e8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3e178275-1ed1-499d-a57a-a453f69b26c2,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:02.890652 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-3da599b5-8b50-4a82-8973-7e54433bd5e8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:02.899076 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3da599b5-8b50-4a82-8973-7e54433bd5e8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:02.900420 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-3da599b5-8b50-4a82-8973-7e54433bd5e8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1426105
May 31 16:25:02.903511 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 35254) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:02.909051 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Request body: {'floatingip': {'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:25:02.914744 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:25:02.918636 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Usage tracker for resource:floatingip and tenant:12203182731d4a61acb7fc5914aef425 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:25:02.921438 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:25:02.927165 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:25:02.937933 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for floatingip, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:03.078960 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:03.222133 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Allocated IP 172.27.0.216 (00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c/96709d85-d0fe-4cf8-b232-eaf6b143ebe6/8a39a909-ef85-4ee5-bd23-355dce119eaa) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:25:03.373411 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:03.405386 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:03.411548 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:03.477032 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:25:03.480534 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:25:03.484446 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:25:03.608113 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Pushing event updated for resources: {'Port': ['ID=8a39a909-ef85-4ee5-bd23-355dce119eaa,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:03.612751 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:03.650357 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:03.711660 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:03.924485 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for port, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:03.929012 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:03.934210 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-33bb40e1-0551-4055-ad94-cb5f9fefc4d5 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:04.042966 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Pushing event updated for resources: {'Port': ['ID=8a39a909-ef85-4ee5-bd23-355dce119eaa,revision_number=2']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:04.045873 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:04.055498 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16621821'] for floatingip, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:04.078399 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for floatingip, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:04.079595 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 1.1751823
May 31 16:25:04.301617 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-cd6fd491-7584-44ae-9370-9e194878de28 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Synchronizing usage tracker for tenant:12203182731d4a61acb7fc5914aef425 on resource:security_group {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:25:04.316486 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-cd6fd491-7584-44ae-9370-9e194878de28 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Unset dirty status for tenant:12203182731d4a61acb7fc5914aef425 on resource:security_group {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:25:04.317635 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-cd6fd491-7584-44ae-9370-9e194878de28 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-securitygroup--473631203&fields=id&tenant_id=12203182731d4a61acb7fc5914aef425 HTTP/1.1" status: 200  len: 267 time: 0.0567408
May 31 16:25:04.471982 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-38854d3a-d43f-4b44-9951-acfe7910c1ff tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:04.473313 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-38854d3a-d43f-4b44-9951-acfe7910c1ff tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/networks?id=be7d7603-734f-43bb-92a8-ed07a835aeb5 HTTP/1.1" status: 200  len: 816 time: 0.1491451
May 31 16:25:04.487894 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-ca784c52-b9fa-49ed-90d4-f274c0a3d3b4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/quotas/12203182731d4a61acb7fc5914aef425 HTTP/1.1" status: 200  len: 375 time: 0.0090518
May 31 16:25:04.574709 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-549676a9-413b-42f7-8707-0f6baa3932dc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Synchronizing usage tracker for tenant:12203182731d4a61acb7fc5914aef425 on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:25:04.591511 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-549676a9-413b-42f7-8707-0f6baa3932dc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Unset dirty status for tenant:12203182731d4a61acb7fc5914aef425 on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:25:04.593688 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-549676a9-413b-42f7-8707-0f6baa3932dc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=12203182731d4a61acb7fc5914aef425&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1006308
May 31 16:25:04.794342 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3d331b6f-4ffa-4fdd-94f8-eba1457ddfb8 service neutron] 10.222.0.43 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1871095
May 31 16:25:04.853634 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 35292) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:04.928127 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-a2e16f7b-3c76-4a94-92b4-f1a5d7151aeb service neutron] 10.222.0.43 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1277282
May 31 16:25:04.973646 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-c29d2e0d-8ee3-443c-bb4c-9f3aff6d1f91 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:04.988878 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-c29d2e0d-8ee3-443c-bb4c-9f3aff6d1f91 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:25:04.992846 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-c29d2e0d-8ee3-443c-bb4c-9f3aff6d1f91 admin admin] Usage tracker for resource:security_group_rule and tenant:220c78b9244c4731912d270d43f5e627 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:25:04.996436 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-c29d2e0d-8ee3-443c-bb4c-9f3aff6d1f91 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:25:05.004205 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-c29d2e0d-8ee3-443c-bb4c-9f3aff6d1f91 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:25:05.005108 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0dce0718-05fe-4531-8241-a6fa267dec5e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:05.096009 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-c29d2e0d-8ee3-443c-bb4c-9f3aff6d1f91 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:05.100635 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-c29d2e0d-8ee3-443c-bb4c-9f3aff6d1f91 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:05.109834 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-098f6005-0fd9-4f70-80dc-a53efd1b5ce1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:05.150155 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c29d2e0d-8ee3-443c-bb4c-9f3aff6d1f91 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7cb9af99-efbe-448b-92e9-5782e91e7353,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:05.153513 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-c29d2e0d-8ee3-443c-bb4c-9f3aff6d1f91 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:05.160421 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 35306) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:05.161280 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-c29d2e0d-8ee3-443c-bb4c-9f3aff6d1f91 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=220c78b9244c4731912d270d43f5e627&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3063331
May 31 16:25:05.264707 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5ed122b0-150d-4cd0-be62-8900f0ebee34 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:05.289575 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-747f2cfa-a289-40dc-8776-256b6731fe27 req-477e3314-182f-4b90-bb43-fb31f0bb3994 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 210 time: 0.2143078
May 31 16:25:05.308070 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5ed122b0-150d-4cd0-be62-8900f0ebee34 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:05.368213 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5ed122b0-150d-4cd0-be62-8900f0ebee34 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:05.373720 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-a1b4dfd6-dc2b-486b-a444-e01b887aeab6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:05.387500 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ed122b0-150d-4cd0-be62-8900f0ebee34 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7cb9af99-efbe-448b-92e9-5782e91e7353,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:05.391116 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-5ed122b0-150d-4cd0-be62-8900f0ebee34 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:05.395224 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5ed122b0-150d-4cd0-be62-8900f0ebee34 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:05.396319 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-5ed122b0-150d-4cd0-be62-8900f0ebee34 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/7cb9af99-efbe-448b-92e9-5782e91e7353 HTTP/1.1" status: 204  len: 168 time: 0.2355509
May 31 16:25:05.714676 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 35326) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:05.733998 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-00d63907-6f2e-4b38-b454-fbc33934d1e5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:05.753349 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-00d63907-6f2e-4b38-b454-fbc33934d1e5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:25:05.757440 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-00d63907-6f2e-4b38-b454-fbc33934d1e5 admin admin] Usage tracker for resource:security_group_rule and tenant:2ed5087548b449048c358a4828f3fcf6 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:25:05.760402 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-00d63907-6f2e-4b38-b454-fbc33934d1e5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:25:05.766235 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-00d63907-6f2e-4b38-b454-fbc33934d1e5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:25:05.869425 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-00d63907-6f2e-4b38-b454-fbc33934d1e5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:05.873979 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-00d63907-6f2e-4b38-b454-fbc33934d1e5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:05.885833 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-0be81d16-c7f9-4c19-9a6a-aeb45015e50e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:05.929970 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-00d63907-6f2e-4b38-b454-fbc33934d1e5 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=2ed5087548b449048c358a4828f3fcf6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2137764
May 31 16:25:05.931850 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00d63907-6f2e-4b38-b454-fbc33934d1e5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c18e4c6-326b-430e-abdc-cf89d9b5c231,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:05.932651 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 35330) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:05.935856 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-00d63907-6f2e-4b38-b454-fbc33934d1e5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:05.992952 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-aa080f58-6ec0-4a25-9f82-bf1543262104 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:06.027164 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-aa080f58-6ec0-4a25-9f82-bf1543262104 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:06.082342 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-aa080f58-6ec0-4a25-9f82-bf1543262104 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:06.086344 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-c29d2e0d-8ee3-443c-bb4c-9f3aff6d1f91 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:06.103469 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa080f58-6ec0-4a25-9f82-bf1543262104 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c18e4c6-326b-430e-abdc-cf89d9b5c231,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:06.105740 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-aa080f58-6ec0-4a25-9f82-bf1543262104 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:06.112713 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-aa080f58-6ec0-4a25-9f82-bf1543262104 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:06.113906 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-aa080f58-6ec0-4a25-9f82-bf1543262104 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/5c18e4c6-326b-430e-abdc-cf89d9b5c231 HTTP/1.1" status: 204  len: 168 time: 0.1802676
May 31 16:25:06.493465 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-26bfb9ee-ef96-4c2c-86c8-7e3b560822d6 req-d2bb3a04-3bbc-4cc4-930c-43b2bab50253 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 210 time: 0.0726202
May 31 16:25:06.645747 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-7e6929ac-c7be-4e1e-ab3e-1165af0cd5ff tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:06.647526 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-7e6929ac-c7be-4e1e-ab3e-1165af0cd5ff tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.63 "GET /v2.0/networks?id=be7d7603-734f-43bb-92a8-ed07a835aeb5 HTTP/1.1" status: 200  len: 816 time: 0.2264514
May 31 16:25:06.713158 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-af1a5096-b698-4a2a-bf5a-a6c83f411a4c tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Synchronizing usage tracker for tenant:12203182731d4a61acb7fc5914aef425 on resource:security_group {{(pid=91763) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:25:06.732044 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-af1a5096-b698-4a2a-bf5a-a6c83f411a4c tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Unset dirty status for tenant:12203182731d4a61acb7fc5914aef425 on resource:security_group {{(pid=91763) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:25:06.734161 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-af1a5096-b698-4a2a-bf5a-a6c83f411a4c tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.63 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=12203182731d4a61acb7fc5914aef425 HTTP/1.1" status: 200  len: 379 time: 0.0696077
May 31 16:25:06.746561 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-39c25732-6d9b-49ea-915c-aadaf3488000 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Request body: {'port': {'device_id': '61f2d7a8-c7cd-4a2d-9a17-4654f91ad264', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'admin_state_up': True, 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'security_groups': ['8fbc8cfd-84c0-4533-a8cc-20e7833b04de']}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:25:06.903504 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-39c25732-6d9b-49ea-915c-aadaf3488000 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:25:06.920551 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-39c25732-6d9b-49ea-915c-aadaf3488000 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:25:06.932299 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-39c25732-6d9b-49ea-915c-aadaf3488000 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Made reservation on behalf of 12203182731d4a61acb7fc5914aef425 for: {'port': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:25:06.936772 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-39c25732-6d9b-49ea-915c-aadaf3488000 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:07.121825 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-39c25732-6d9b-49ea-915c-aadaf3488000 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Allocated IP 172.20.0.13 (be7d7603-734f-43bb-92a8-ed07a835aeb5/eb5363fe-ee39-4adc-b299-6098caad681d/49427db6-0261-4969-89c1-47664fa8a818) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:25:07.332439 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-39c25732-6d9b-49ea-915c-aadaf3488000 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:07.349794 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.provisioning_blocks [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-39c25732-6d9b-49ea-915c-aadaf3488000 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Transition to ACTIVE for port object 49427db6-0261-4969-89c1-47664fa8a818 will not be triggered until provisioned by entity DHCP. {{(pid=91763) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:25:07.375208 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-39c25732-6d9b-49ea-915c-aadaf3488000 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:07.383139 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-b9e31ea1-79eb-4f81-b325-dafe929ba765 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:07.556071 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-39c25732-6d9b-49ea-915c-aadaf3488000 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Network be7d7603-734f-43bb-92a8-ed07a835aeb5 is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:25:07.559344 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-39c25732-6d9b-49ea-915c-aadaf3488000 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:25:07.563538 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-39c25732-6d9b-49ea-915c-aadaf3488000 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:25:07.642035 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-39c25732-6d9b-49ea-915c-aadaf3488000 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:07.643800 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-39c25732-6d9b-49ea-915c-aadaf3488000 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:07.648622 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39c25732-6d9b-49ea-915c-aadaf3488000 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Pushing event updated for resources: {'Port': ['ID=49427db6-0261-4969-89c1-47664fa8a818,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:07.660780 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-39c25732-6d9b-49ea-915c-aadaf3488000 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.278s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:07.700679 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-39c25732-6d9b-49ea-915c-aadaf3488000 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.63 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.9585495
May 31 16:25:07.737714 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23def199-9b02-41d9-97f4-692a4811d103 req-db539edb-1c56-42be-ac93-d34da9ef4ee2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:07.739037 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-23def199-9b02-41d9-97f4-692a4811d103 req-db539edb-1c56-42be-ac93-d34da9ef4ee2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 932 time: 0.1064820
May 31 16:25:07.797511 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-23def199-9b02-41d9-97f4-692a4811d103 req-245fe402-754b-4caf-b600-915f060961b8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0442169
May 31 16:25:07.886793 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-63cceb41-96fb-4ab6-86d6-bb23c0e41ef8 None None] Provisioning for port 49427db6-0261-4969-89c1-47664fa8a818 completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:25:07.893746 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-63cceb41-96fb-4ab6-86d6-bb23c0e41ef8 None None] Provisioning complete for port 49427db6-0261-4969-89c1-47664fa8a818 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:25:07.894113 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-63cceb41-96fb-4ab6-86d6-bb23c0e41ef8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:07.923532 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:07.958928 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-63cceb41-96fb-4ab6-86d6-bb23c0e41ef8 None None] Port 49427db6-0261-4969-89c1-47664fa8a818 cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:25:08.219291 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-aee63172-01ba-4c08-8996-c2a9f8378c16 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:08.991931 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6940404c-f753-4344-a824-48a67ed1b1ea req-3b07f28c-05ab-4346-b94f-c0d796e243c4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:08.993394 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6940404c-f753-4344-a824-48a67ed1b1ea req-3b07f28c-05ab-4346-b94f-c0d796e243c4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 932 time: 0.0827920
May 31 16:25:09.038013 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6940404c-f753-4344-a824-48a67ed1b1ea req-ffd35bb3-b449-4a88-9e9c-f9b85a03cc45 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0389054
May 31 16:25:09.155130 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:10.247019 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-241bed5c-7c78-4fbe-9248-e9001d447307 req-4eab9256-9897-49a0-b7e7-e803abab6001 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:10.248549 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-241bed5c-7c78-4fbe-9248-e9001d447307 req-4eab9256-9897-49a0-b7e7-e803abab6001 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 932 time: 0.0903721
May 31 16:25:10.305030 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-241bed5c-7c78-4fbe-9248-e9001d447307 req-0a217dd9-ec4c-4c88-92d2-8f840fb68d57 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0494790
May 31 16:25:10.616328 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Request body: {'port': {'device_id': '61f2d7a8-c7cd-4a2d-9a17-4654f91ad264', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79381'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:25:10.735714 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:10.862053 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:11.114103 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 49427db6-0261-4969-89c1-47664fa8a818 {{(pid=91763) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:25:11.122955 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:11.145823 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.provisioning_blocks [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Transition to ACTIVE for port object 49427db6-0261-4969-89c1-47664fa8a818 will not be triggered until provisioned by entity L2. {{(pid=91763) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:25:11.150288 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14337082'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:11.154547 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:11.322351 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Pushing event updated for resources: {'Port': ['ID=49427db6-0261-4969-89c1-47664fa8a818,revision_number=2']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:11.331051 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:11.414415 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Attempting to bind port 49427db6-0261-4969-89c1-47664fa8a818 on host hv-cinder-79381 for vnic_type normal with profile  {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:25:11.414739 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Attempting to bind port 49427db6-0261-4969-89c1-47664fa8a818 by drivers openvswitch,hyperv on host hv-cinder-79381 at level 0 using segments [{'id': '39cd3b8c-a501-4003-900e-4c3bab514801', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 806, 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5'}] {{(pid=91763) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:25:11.415077 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Attempting to bind port 49427db6-0261-4969-89c1-47664fa8a818 on network be7d7603-734f-43bb-92a8-ed07a835aeb5 {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:25:11.420850 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Port 49427db6-0261-4969-89c1-47664fa8a818 on network be7d7603-734f-43bb-92a8-ed07a835aeb5 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79381 {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 31 16:25:11.421242 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Attempting to bind port 49427db6-0261-4969-89c1-47664fa8a818 on network be7d7603-734f-43bb-92a8-ed07a835aeb5 {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:25:11.432408 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Checking agent: {'id': '4bed2638-4d91-4afb-bf81-aacca8584621', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79381', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'started_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 24, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:25:11.432755 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Checking segment: {'id': '39cd3b8c-a501-4003-900e-4c3bab514801', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 806, 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91763) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:25:11.433153 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Bound using segment: {'id': '39cd3b8c-a501-4003-900e-4c3bab514801', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 806, 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5'} {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:25:11.433631 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Bound port: 49427db6-0261-4969-89c1-47664fa8a818, host: hv-cinder-79381, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '39cd3b8c-a501-4003-900e-4c3bab514801', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 806, 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5'}}] {{(pid=91763) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:25:11.433995 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:11.534220 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc2acc54-f990-4953-9d52-730d6369e04c req-30ab1674-0724-4427-8d30-556417ac5eeb tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:11.535994 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-dc2acc54-f990-4953-9d52-730d6369e04c req-30ab1674-0724-4427-8d30-556417ac5eeb tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 944 time: 0.1089973
May 31 16:25:11.560040 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] For port 49427db6-0261-4969-89c1-47664fa8a818, host hv-cinder-79381, cleared binding levels {{(pid=91763) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:25:11.563935 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] For port 49427db6-0261-4969-89c1-47664fa8a818, host hv-cinder-79381, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=49427db6-0261-4969-89c1-47664fa8a818,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91763) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:25:11.570475 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14337082'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:11.575620 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-2c95a735-739e-4493-97d6-e6acd4274fda tempest-ServerRescueNegativeTestJSON-1138825361 tempest-ServerRescueNegativeTestJSON-1138825361-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:11.646913 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:11.646913 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:11.646913 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] 10.222.0.63 "PUT /v2.0/ports/49427db6-0261-4969-89c1-47664fa8a818 HTTP/1.1" status: 200  len: 1094 time: 1.0286589
May 31 16:25:11.646913 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '61f2d7a8-c7cd-4a2d-9a17-4654f91ad264', 'tag': '49427db6-0261-4969-89c1-47664fa8a818'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:25:11.646913 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9d7afb33-033e-47f0-afce-544dac4bc118" -d '{"events": [{"name": "network-changed", "server_uuid": "61f2d7a8-c7cd-4a2d-9a17-4654f91ad264", "tag": "49427db6-0261-4969-89c1-47664fa8a818"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:25:11.691383 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Pushing event updated for resources: {'Port': ['ID=49427db6-0261-4969-89c1-47664fa8a818,revision_number=3']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:11.701226 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:11.768484 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-dc2acc54-f990-4953-9d52-730d6369e04c req-d92ac0e9-b3dc-4ca5-aaca-230cfdd8f434 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2240691
May 31 16:25:11.794320 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:25:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-82858696-26ca-4845-9b53-e8f8d2ab02c0 x-openstack-request-id: req-82858696-26ca-4845-9b53-e8f8d2ab02c0 {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:25:11.794320 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "61f2d7a8-c7cd-4a2d-9a17-4654f91ad264", "tag": "49427db6-0261-4969-89c1-47664fa8a818", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:25:11.794320 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-82858696-26ca-4845-9b53-e8f8d2ab02c0 {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:25:11.794320 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '61f2d7a8-c7cd-4a2d-9a17-4654f91ad264', 'tag': '49427db6-0261-4969-89c1-47664fa8a818', 'status': 'completed', 'code': 200}
May 31 16:25:11.871977 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-53144d26-a298-4ee8-b60e-fe7c3ed65860 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:11.874709 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-53144d26-a298-4ee8-b60e-fe7c3ed65860 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=12203182731d4a61acb7fc5914aef425&device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 1097 time: 0.1442275
May 31 16:25:12.094245 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-854227b2-6129-4203-ab5d-5432665cca97 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=49427db6-0261-4969-89c1-47664fa8a818 HTTP/1.1" status: 200  len: 217 time: 0.2084680
May 31 16:25:12.982969 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3c931ec-cfeb-4a24-a12b-688aeb643a0b req-1ef622c1-1029-403c-87ee-48f4d5b98906 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:12.985477 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b3c931ec-cfeb-4a24-a12b-688aeb643a0b req-1ef622c1-1029-403c-87ee-48f4d5b98906 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 944 time: 0.1022232
May 31 16:25:13.045388 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b3c931ec-cfeb-4a24-a12b-688aeb643a0b req-ad962e6c-8916-46db-82b1-5143bbdadd09 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0522470
May 31 16:25:14.421321 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57c966fd-b41f-442d-80e9-cd8dac3a9641 req-a08bc9c8-2c09-4686-9d1f-04460a3740ac tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:14.422797 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-57c966fd-b41f-442d-80e9-cd8dac3a9641 req-a08bc9c8-2c09-4686-9d1f-04460a3740ac tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 944 time: 0.0845847
May 31 16:25:14.467423 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-57c966fd-b41f-442d-80e9-cd8dac3a9641 req-6855f996-d58e-4cd9-b240-7cce451b79ac tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0384474
May 31 16:25:15.123776 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-d45756ec-690e-44ae-b997-86fec8f99854 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:15.125503 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-d45756ec-690e-44ae-b997-86fec8f99854 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=eb5363fe-ee39-4adc-b299-6098caad681d HTTP/1.1" status: 200  len: 855 time: 0.0701811
May 31 16:25:15.159697 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5b5c65af-2e88-4159-90c1-4dbecfaf3802 req-71e12c51-9fbc-47f1-9b77-7feb88bc7ece service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0715692
May 31 16:25:15.219199 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-2dbda4f5-9852-4684-83a1-c244d5726fda service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:15.222255 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-2dbda4f5-9852-4684-83a1-c244d5726fda service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=be7d7603-734f-43bb-92a8-ed07a835aeb5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0879695
May 31 16:25:15.323605 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b5c65af-2e88-4159-90c1-4dbecfaf3802 req-62ed6554-ed3a-4a93-9327-512a86d55098 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:15.325047 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5b5c65af-2e88-4159-90c1-4dbecfaf3802 req-62ed6554-ed3a-4a93-9327-512a86d55098 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=092115f69b8e401b8c334f7b3e797aad&device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 1098 time: 0.0834053
May 31 16:25:15.370345 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-0a47fa69-c793-4ff9-9f9d-3e352fef903b service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1353717
May 31 16:25:15.512423 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b5c65af-2e88-4159-90c1-4dbecfaf3802 req-c845720d-b3d4-4d52-8caf-7cd53f84c53c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:15.514016 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5b5c65af-2e88-4159-90c1-4dbecfaf3802 req-c845720d-b3d4-4d52-8caf-7cd53f84c53c service neutron] 10.222.0.63 "GET /v2.0/networks?id=5b237728-dc31-4203-bbac-66ce3db1593a HTTP/1.1" status: 200  len: 913 time: 0.1646421
May 31 16:25:15.552190 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-464bc5ae-2e6f-41a0-8332-edefd61820de req-adb148f9-f8d5-44eb-96d8-c6c6a1c30b86 service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1709051
May 31 16:25:15.673277 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5b5c65af-2e88-4159-90c1-4dbecfaf3802 req-d6262629-0c76-44b6-84f9-e323b9d647dc service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b HTTP/1.1" status: 200  len: 1001 time: 0.1503050
May 31 16:25:15.730583 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d7afb33-033e-47f0-afce-544dac4bc118 req-13f52249-31db-4a96-8f29-9c39d5ae5328 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:15.732395 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-9d7afb33-033e-47f0-afce-544dac4bc118 req-13f52249-31db-4a96-8f29-9c39d5ae5328 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=12203182731d4a61acb7fc5914aef425&device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 1097 time: 0.1145847
May 31 16:25:15.813203 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b5c65af-2e88-4159-90c1-4dbecfaf3802 req-951b37e1-3e3e-459a-8c2f-80352bc6b511 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:15.815153 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5b5c65af-2e88-4159-90c1-4dbecfaf3802 req-951b37e1-3e3e-459a-8c2f-80352bc6b511 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=995d9a2e-7e88-458e-9385-d135c0e07276 HTTP/1.1" status: 200  len: 851 time: 0.0865788
May 31 16:25:15.834460 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5597b07a-1f04-4648-9049-3c73378147c1 req-21de7259-e1a8-423a-a2e0-4c3de59416c2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:15.841633 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5597b07a-1f04-4648-9049-3c73378147c1 req-21de7259-e1a8-423a-a2e0-4c3de59416c2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 944 time: 0.1706038
May 31 16:25:15.894067 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 35476) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:15.953648 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5597b07a-1f04-4648-9049-3c73378147c1 req-0ce9c6c0-a017-4c67-9bcc-1881669c69f9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1107903
May 31 16:25:15.977700 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b5c65af-2e88-4159-90c1-4dbecfaf3802 req-c0245171-ca64-44ea-a6d2-dd0264ad960a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:15.979378 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5b5c65af-2e88-4159-90c1-4dbecfaf3802 req-c0245171-ca64-44ea-a6d2-dd0264ad960a service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=5b237728-dc31-4203-bbac-66ce3db1593a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1350803
May 31 16:25:15.984631 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d7afb33-033e-47f0-afce-544dac4bc118 req-e8ad28f4-0313-43cb-97f8-28def5ae02b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:15.986909 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-9d7afb33-033e-47f0-afce-544dac4bc118 req-e8ad28f4-0313-43cb-97f8-28def5ae02b6 service neutron] 10.222.0.63 "GET /v2.0/networks?id=be7d7603-734f-43bb-92a8-ed07a835aeb5 HTTP/1.1" status: 200  len: 917 time: 0.2406099
May 31 16:25:16.079235 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-9d7afb33-033e-47f0-afce-544dac4bc118 req-647795d6-6ab9-409b-9146-a064a7915a02 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=49427db6-0261-4969-89c1-47664fa8a818 HTTP/1.1" status: 200  len: 217 time: 0.0854359
May 31 16:25:16.108642 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:16.141994 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:25:16.149886 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Usage tracker for resource:security_group_rule and tenant:c0db06b3f92b4429b2b65e11e90c254f is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:25:16.154984 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:25:16.173149 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:25:16.183282 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5b5c65af-2e88-4159-90c1-4dbecfaf3802 req-314e3900-1770-4ae2-ae15-0147223e8de6 service neutron] 10.222.0.63 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1947954
May 31 16:25:16.192886 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d7afb33-033e-47f0-afce-544dac4bc118 req-03c3b0ea-91b7-4bba-aaeb-63e798b143fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:16.195135 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-9d7afb33-033e-47f0-afce-544dac4bc118 req-03c3b0ea-91b7-4bba-aaeb-63e798b143fc service neutron] 10.222.0.63 "GET /v2.0/subnets?id=eb5363fe-ee39-4adc-b299-6098caad681d HTTP/1.1" status: 200  len: 855 time: 0.1017048
May 31 16:25:16.288078 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d7afb33-033e-47f0-afce-544dac4bc118 req-c0cf59f5-8432-4dc4-8f29-4b32ca76c537 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:16.289735 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-9d7afb33-033e-47f0-afce-544dac4bc118 req-c0cf59f5-8432-4dc4-8f29-4b32ca76c537 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=be7d7603-734f-43bb-92a8-ed07a835aeb5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0863349
May 31 16:25:16.375322 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5b5c65af-2e88-4159-90c1-4dbecfaf3802 req-aadccb0f-ab76-4468-8d38-d1634bd8603c service neutron] 10.222.0.63 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1773055
May 31 16:25:16.404574 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:16.410433 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:16.420636 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-00d63907-6f2e-4b38-b454-fbc33934d1e5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:16.436177 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-9d7afb33-033e-47f0-afce-544dac4bc118 req-5ed3c72b-c1ca-4dd9-b301-1c6ecff5296f service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1378560
May 31 16:25:16.463001 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=c0db06b3f92b4429b2b65e11e90c254f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5634410
May 31 16:25:16.463850 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=47a240bb-f6f2-4950-a254-d9bd66093786,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:16.465867 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 35486) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:16.488071 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:16.488655 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:16.489063 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:16.489435 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:16.489826 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:16.490196 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:16.490559 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:16.490919 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:16.491301 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:16.491638 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:16.491994 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:16.492348 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:16.496401 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:16.542860 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5fb2a352-2a83-43f6-8720-2255075cda9f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:16.569711 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5fb2a352-2a83-43f6-8720-2255075cda9f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:16.577624 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-9d7afb33-033e-47f0-afce-544dac4bc118 req-eb9f04fe-69d9-43c6-a987-0b0e3ea9a597 service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1303158
May 31 16:25:16.621475 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5fb2a352-2a83-43f6-8720-2255075cda9f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:16.626222 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-0799be5e-f793-4fa5-9d80-3f38339b7e4e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:16.638888 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fb2a352-2a83-43f6-8720-2255075cda9f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=47a240bb-f6f2-4950-a254-d9bd66093786,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:16.641670 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-5fb2a352-2a83-43f6-8720-2255075cda9f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:16.648743 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5fb2a352-2a83-43f6-8720-2255075cda9f admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:16.649865 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-5fb2a352-2a83-43f6-8720-2255075cda9f admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/47a240bb-f6f2-4950-a254-d9bd66093786 HTTP/1.1" status: 204  len: 168 time: 0.1830907
May 31 16:25:16.950889 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 35494) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:16.968587 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-4b4367b1-138d-4cab-9ad3-0999bb420a96 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:16.989907 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-4b4367b1-138d-4cab-9ad3-0999bb420a96 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:25:16.993984 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-4b4367b1-138d-4cab-9ad3-0999bb420a96 admin admin] Usage tracker for resource:security_group_rule and tenant:bd2d7c74d72d4fb69d28f0f6ee7b104a is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:25:16.996921 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-4b4367b1-138d-4cab-9ad3-0999bb420a96 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:25:17.004373 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-4b4367b1-138d-4cab-9ad3-0999bb420a96 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:25:17.094647 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-4b4367b1-138d-4cab-9ad3-0999bb420a96 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:17.133147 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-4b4367b1-138d-4cab-9ad3-0999bb420a96 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:17.146530 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-04058d24-f9ec-4f4d-9bb1-19e5c4e92518 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:17.199387 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-4b4367b1-138d-4cab-9ad3-0999bb420a96 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=bd2d7c74d72d4fb69d28f0f6ee7b104a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2450151
May 31 16:25:17.199704 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 35504) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:17.200194 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b4367b1-138d-4cab-9ad3-0999bb420a96 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fed55394-58a8-4ed9-8396-0fb48a2e9bfa,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:17.204259 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-4b4367b1-138d-4cab-9ad3-0999bb420a96 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:17.231789 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ec85c0b-762b-4b37-8f7d-1a3c044c1ab7 req-fc198c8c-4c16-49b9-b61d-9cdcbba0cbfd tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:17.233287 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9ec85c0b-762b-4b37-8f7d-1a3c044c1ab7 req-fc198c8c-4c16-49b9-b61d-9cdcbba0cbfd tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 944 time: 0.1364112
May 31 16:25:17.287821 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9ec85c0b-762b-4b37-8f7d-1a3c044c1ab7 req-f8c6ff8a-3e59-4022-b052-219e670090e8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0475938
May 31 16:25:17.289391 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-81b83c5b-3bef-44c1-badd-0c62fc1198dc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:17.319583 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-81b83c5b-3bef-44c1-badd-0c62fc1198dc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:17.373225 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-81b83c5b-3bef-44c1-badd-0c62fc1198dc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:17.379231 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-a00a8125-988c-483e-a868-5c22d188afb1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:17.389688 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81b83c5b-3bef-44c1-badd-0c62fc1198dc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fed55394-58a8-4ed9-8396-0fb48a2e9bfa,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:17.394381 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-81b83c5b-3bef-44c1-badd-0c62fc1198dc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:17.396442 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-81b83c5b-3bef-44c1-badd-0c62fc1198dc admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:17.397551 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-81b83c5b-3bef-44c1-badd-0c62fc1198dc admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/fed55394-58a8-4ed9-8396-0fb48a2e9bfa HTTP/1.1" status: 204  len: 168 time: 0.1968575
May 31 16:25:17.895197 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1832fd7-3ace-4cde-b18d-8c3879431ed2 req-8b820215-f725-4598-be0e-50a91ff740b0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:17.896700 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e1832fd7-3ace-4cde-b18d-8c3879431ed2 req-8b820215-f725-4598-be0e-50a91ff740b0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 945 time: 0.0885849
May 31 16:25:17.943204 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e1832fd7-3ace-4cde-b18d-8c3879431ed2 req-83ae1c71-7721-4ae5-b558-2a1eb3f9f142 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0405586
May 31 16:25:18.508759 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-447c37ee-2e9f-464b-ad8b-f936f1bb7b9f req-2aa84971-2380-4fb7-95c3-2cf8f0f6df26 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:18.515816 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-447c37ee-2e9f-464b-ad8b-f936f1bb7b9f req-2aa84971-2380-4fb7-95c3-2cf8f0f6df26 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 944 time: 0.1033185
May 31 16:25:18.656250 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-447c37ee-2e9f-464b-ad8b-f936f1bb7b9f req-f91676c5-135e-40a2-9f46-8b89c0e3cc08 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1394935
May 31 16:25:19.141518 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ae9d17-e776-49c0-9099-c4b5d0c6d0a3 req-e5fe00a6-a88a-4757-a417-289f213ba806 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:19.143179 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-19ae9d17-e776-49c0-9099-c4b5d0c6d0a3 req-e5fe00a6-a88a-4757-a417-289f213ba806 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 945 time: 0.0804753
May 31 16:25:19.191497 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-19ae9d17-e776-49c0-9099-c4b5d0c6d0a3 req-0aa427da-a39f-4b1b-b656-5b16b61ae137 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0426495
May 31 16:25:19.655683 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:19.702587 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 49427db6-0261-4969-89c1-47664fa8a818 details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:25:19.846027 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 49427db6-0261-4969-89c1-47664fa8a818, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=49427db6-0261-4969-89c1-47664fa8a818,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:25:19.862226 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': '49427db6-0261-4969-89c1-47664fa8a818', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'port_id': '49427db6-0261-4969-89c1-47664fa8a818', 'mac_address': 'fa:16:3e:ca:d5:90', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 806, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:25:19.897465 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c919e9-68b5-41a3-acb1-6072cd50d861 req-55be0476-3eda-48f3-b770-0820ac38ff4a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:19.899101 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-83c919e9-68b5-41a3-acb1-6072cd50d861 req-55be0476-3eda-48f3-b770-0820ac38ff4a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 944 time: 0.0865469
May 31 16:25:19.943939 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:19.953302 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-83c919e9-68b5-41a3-acb1-6072cd50d861 req-1f56d9a5-0a87-435e-a239-5b7e5bcd1828 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0481560
May 31 16:25:19.965090 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 49427db6-0261-4969-89c1-47664fa8a818 {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:25:19.990101 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 49427db6-0261-4969-89c1-47664fa8a818, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=49427db6-0261-4969-89c1-47664fa8a818,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:25:20.006723 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:20.009347 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:20.064308 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca15bd0d-09f9-499a-9df4-1df06fbde481 req-b4e295c7-b8cd-4417-8c83-92b8b471df33 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:20.065023 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-ca15bd0d-09f9-499a-9df4-1df06fbde481 req-b4e295c7-b8cd-4417-8c83-92b8b471df33 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Synchronizing usage tracker for tenant:092115f69b8e401b8c334f7b3e797aad on resource:port {{(pid=91763) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:25:20.080850 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-ca15bd0d-09f9-499a-9df4-1df06fbde481 req-b4e295c7-b8cd-4417-8c83-92b8b471df33 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Unset dirty status for tenant:092115f69b8e401b8c334f7b3e797aad on resource:port {{(pid=91763) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:25:20.081787 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=49427db6-0261-4969-89c1-47664fa8a818,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:20.082289 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-ca15bd0d-09f9-499a-9df4-1df06fbde481 req-b4e295c7-b8cd-4417-8c83-92b8b471df33 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.63 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 945 time: 0.1360412
May 31 16:25:20.084916 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:20.240253 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-ca15bd0d-09f9-499a-9df4-1df06fbde481 req-8760a860-81ee-40ff-81fa-d9c0fba16fa9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Deleting port 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:25:20.240840 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-ca15bd0d-09f9-499a-9df4-1df06fbde481 req-8760a860-81ee-40ff-81fa-d9c0fba16fa9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:20.383530 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-ca15bd0d-09f9-499a-9df4-1df06fbde481 req-8760a860-81ee-40ff-81fa-d9c0fba16fa9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] For port 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b,segment=NetworkSegment(fb1fd409-498f-4f29-82bc-1d244a7a3ed1),segment_id=fb1fd409-498f-4f29-82bc-1d244a7a3ed1)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:25:20.383885 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-ca15bd0d-09f9-499a-9df4-1df06fbde481 req-8760a860-81ee-40ff-81fa-d9c0fba16fa9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:20.388139 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddc90cdd-8c70-41f4-9b8d-158af8f660d1 req-578d9817-2d3c-4dd6-87a5-c64ea7b8a35e tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:20.389657 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ddc90cdd-8c70-41f4-9b8d-158af8f660d1 req-578d9817-2d3c-4dd6-87a5-c64ea7b8a35e tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 945 time: 0.0885289
May 31 16:25:20.394171 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['49427db6-0261-4969-89c1-47664fa8a818'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:25:20.440978 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ddc90cdd-8c70-41f4-9b8d-158af8f660d1 req-318a0d0a-95ca-4534-a803-934a8629f9f5 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0438194
May 31 16:25:20.702914 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-ca15bd0d-09f9-499a-9df4-1df06fbde481 req-8760a860-81ee-40ff-81fa-d9c0fba16fa9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:20.703288 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-ca15bd0d-09f9-499a-9df4-1df06fbde481 req-8760a860-81ee-40ff-81fa-d9c0fba16fa9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16621821'] for floatingip, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:20.703603 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.l3_db [req-ca15bd0d-09f9-499a-9df4-1df06fbde481 req-8760a860-81ee-40ff-81fa-d9c0fba16fa9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Floating IP 3c15c76f-9cda-471e-b526-617f49a22ed5 disassociated. External IP: 172.27.0.222, port: 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b.
May 31 16:25:20.703963 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-ca15bd0d-09f9-499a-9df4-1df06fbde481 req-8760a860-81ee-40ff-81fa-d9c0fba16fa9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Calling delete_port for 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b owned by compute:nova {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:25:20.856103 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-ca15bd0d-09f9-499a-9df4-1df06fbde481 req-8760a860-81ee-40ff-81fa-d9c0fba16fa9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:20.862902 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-03d94c5a-956b-4893-95f1-155dda05f930 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:20.912569 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8760a860-81ee-40ff-81fa-d9c0fba16fa9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Pushing event deleted for resources: {'Port': ['ID=95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:20.916126 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-8760a860-81ee-40ff-81fa-d9c0fba16fa9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:21.211135 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-727a3765-c897-438b-8b32-4f42f53674f0 req-01f47437-6917-496c-ac4a-3d35d25b6923 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:21.212574 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-727a3765-c897-438b-8b32-4f42f53674f0 req-01f47437-6917-496c-ac4a-3d35d25b6923 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 945 time: 0.0898042
May 31 16:25:21.214561 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [req-ca15bd0d-09f9-499a-9df4-1df06fbde481 req-8760a860-81ee-40ff-81fa-d9c0fba16fa9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Router 80126872-1960-4f13-9ca2-0eaf66181e32 has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91763) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:25:21.299269 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-727a3765-c897-438b-8b32-4f42f53674f0 req-74a6bb8b-e450-4e72-87fb-5a5f1ff91065 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0754895
May 31 16:25:21.461353 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-ca15bd0d-09f9-499a-9df4-1df06fbde481 req-8760a860-81ee-40ff-81fa-d9c0fba16fa9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:25:21.474471 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04c7f80e-232e-473a-9f2d-21a12c8d13da None None] Sync routers for ids ['80126872-1960-4f13-9ca2-0eaf66181e32'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:25:21.496232 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04c7f80e-232e-473a-9f2d-21a12c8d13da None None] Routers {'80126872-1960-4f13-9ca2-0eaf66181e32'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:25:21.496968 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-04c7f80e-232e-473a-9f2d-21a12c8d13da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426010940>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:25:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['80126872-1960-4f13-9ca2-0eaf66181e32'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:21.586751 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [req-ca15bd0d-09f9-499a-9df4-1df06fbde481 req-8760a860-81ee-40ff-81fa-d9c0fba16fa9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] No DVR routers for this DVR port 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b on host hv-cinder-79381 {{(pid=91763) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:25:21.590574 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-ca15bd0d-09f9-499a-9df4-1df06fbde481 req-8760a860-81ee-40ff-81fa-d9c0fba16fa9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:21.593910 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '643ad40e-ebf7-432d-ae76-1ce2164e9eec', 'name': 'network-vif-deleted', 'tag': '95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:25:21.596785 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-74f92b62-42dc-4156-9504-ccde29fef51c" -d '{"events": [{"server_uuid": "643ad40e-ebf7-432d-ae76-1ce2164e9eec", "name": "network-vif-deleted", "tag": "95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:25:21.613291 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-ca15bd0d-09f9-499a-9df4-1df06fbde481 req-8760a860-81ee-40ff-81fa-d9c0fba16fa9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.63 "DELETE /v2.0/ports/95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b HTTP/1.1" status: 204  len: 173 time: 1.5150380
May 31 16:25:21.641334 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b88be535-fae6-422c-94d7-abeda6ac3510 req-88c9ba95-95dc-4392-aea6-3a4523ccd4fd tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=643ad40e-ebf7-432d-ae76-1ce2164e9eec HTTP/1.1" status: 200  len: 210 time: 0.0499957
May 31 16:25:21.724273 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:25:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-897d5dd6-0a20-4214-b2cd-66c93116454d x-openstack-request-id: req-897d5dd6-0a20-4214-b2cd-66c93116454d {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:25:21.724462 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-04c7f80e-232e-473a-9f2d-21a12c8d13da None None] Set router 80126872-1960-4f13-9ca2-0eaf66181e32 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:25:21.724725 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "643ad40e-ebf7-432d-ae76-1ce2164e9eec", "name": "network-vif-deleted", "tag": "95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:25:21.725131 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-897d5dd6-0a20-4214-b2cd-66c93116454d {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:25:21.725758 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '643ad40e-ebf7-432d-ae76-1ce2164e9eec', 'name': 'network-vif-deleted', 'tag': '95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b', 'status': 'completed', 'code': 200}
May 31 16:25:21.769393 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 49427db6-0261-4969-89c1-47664fa8a818 up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:25:21.820232 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6a61498-ee2f-46b5-979f-93fb54108aff req-bf46e644-4db5-4502-91ed-c7f159136909 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:21.821725 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b6a61498-ee2f-46b5-979f-93fb54108aff req-bf46e644-4db5-4502-91ed-c7f159136909 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 945 time: 0.0831828
May 31 16:25:21.868635 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b6a61498-ee2f-46b5-979f-93fb54108aff req-091c7f0a-79ad-4db8-a022-96065d22d04a tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409288
May 31 16:25:22.005791 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning for port 49427db6-0261-4969-89c1-47664fa8a818 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:25:22.013944 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port 49427db6-0261-4969-89c1-47664fa8a818 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:25:22.014319 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:22.234504 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:22.267428 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-04c7f80e-232e-473a-9f2d-21a12c8d13da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426010940>, [{'id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229'}], 'enable_snat': True}, 'gw_port_id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:05Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 4, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'gw_port': {'id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:b8:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:06Z', 'updated_at': '2021-05-31T16:21:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '27a83f61-e253-4ba1-954c-e810e9a33917', 'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'mac_address': 'fa:16:3e:fc:8a:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_interface', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:09Z', 'updated_at': '2021-05-31T16:21:20Z', 'revision_number': 5, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'subnets': [{'id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:22.274147 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '61f2d7a8-c7cd-4a2d-9a17-4654f91ad264', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '49427db6-0261-4969-89c1-47664fa8a818'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:25:22.276767 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8060444b-bf98-45d9-857e-f8a0823766c6" -d '{"events": [{"server_uuid": "61f2d7a8-c7cd-4a2d-9a17-4654f91ad264", "name": "network-vif-plugged", "status": "completed", "tag": "49427db6-0261-4969-89c1-47664fa8a818"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:25:22.285986 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04c7f80e-232e-473a-9f2d-21a12c8d13da None None] Checking router: 80126872-1960-4f13-9ca2-0eaf66181e32 for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:25:22.289310 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 49427db6-0261-4969-89c1-47664fa8a818, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=49427db6-0261-4969-89c1-47664fa8a818,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:25:22.297993 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:22.299422 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:25:22.335290 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:25:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-637ddd3e-3ec9-4d36-89a1-71c27f28e327 x-openstack-request-id: req-637ddd3e-3ec9-4d36-89a1-71c27f28e327 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:25:22.335568 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "61f2d7a8-c7cd-4a2d-9a17-4654f91ad264", "name": "network-vif-plugged", "status": "completed", "tag": "49427db6-0261-4969-89c1-47664fa8a818", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:25:22.335872 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-637ddd3e-3ec9-4d36-89a1-71c27f28e327 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:25:22.336144 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '61f2d7a8-c7cd-4a2d-9a17-4654f91ad264', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '49427db6-0261-4969-89c1-47664fa8a818', 'code': 200}
May 31 16:25:22.336686 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-1ef1d3b2-e8c1-466e-86ad-f6726b68351a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:22.392006 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] No Port match for: 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:25:22.392920 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 95a8b94d-f4c1-4965-ad7b-0a5de6a18b7b not bound to the agent host hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:25:22.402465 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04c7f80e-232e-473a-9f2d-21a12c8d13da None None] Routers {'80126872-1960-4f13-9ca2-0eaf66181e32'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:25:22.403124 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-04c7f80e-232e-473a-9f2d-21a12c8d13da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426010940>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:25:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['80126872-1960-4f13-9ca2-0eaf66181e32'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:22.519890 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=49427db6-0261-4969-89c1-47664fa8a818,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:22.526135 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0f3cc53-f4cf-4f9d-9b06-09633386cd54 req-6eb2e84a-1935-4953-ae59-7fb7ea2b9d46 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:22.527792 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b0f3cc53-f4cf-4f9d-9b06-09633386cd54 req-6eb2e84a-1935-4953-ae59-7fb7ea2b9d46 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.1031911
May 31 16:25:22.537957 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:22.598201 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b0f3cc53-f4cf-4f9d-9b06-09633386cd54 req-07a9612a-741b-4bc9-a739-85bd52da8094 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0635519
May 31 16:25:22.671842 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-747c5d22-2208-4ac7-bf47-89a43b2ea21c req-823b44ba-4ba5-4fea-b3d3-b50f949777e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:22.674099 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-747c5d22-2208-4ac7-bf47-89a43b2ea21c req-823b44ba-4ba5-4fea-b3d3-b50f949777e3 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 1099 time: 0.1054513
May 31 16:25:22.699643 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-04c7f80e-232e-473a-9f2d-21a12c8d13da None None] Set router 80126872-1960-4f13-9ca2-0eaf66181e32 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:25:22.737358 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-747c5d22-2208-4ac7-bf47-89a43b2ea21c req-e28b8115-3dcb-443e-8450-06f84f0385c0 service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0537832
May 31 16:25:23.159934 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-04c7f80e-232e-473a-9f2d-21a12c8d13da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426010940>, [{'id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229'}], 'enable_snat': True}, 'gw_port_id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:05Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 4, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'gw_port': {'id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:b8:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:06Z', 'updated_at': '2021-05-31T16:21:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '27a83f61-e253-4ba1-954c-e810e9a33917', 'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'mac_address': 'fa:16:3e:fc:8a:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_interface', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:09Z', 'updated_at': '2021-05-31T16:21:20Z', 'revision_number': 5, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'subnets': [{'id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:23.164219 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04c7f80e-232e-473a-9f2d-21a12c8d13da None None] The sync data for ids ['80126872-1960-4f13-9ca2-0eaf66181e32'] in dv-cinder-793814-1-iscsi is: [{'id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229'}], 'enable_snat': True}, 'gw_port_id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:05Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 4, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'gw_port': {'id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:b8:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:06Z', 'updated_at': '2021-05-31T16:21:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '27a83f61-e253-4ba1-954c-e810e9a33917', 'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'mac_address': 'fa:16:3e:fc:8a:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_interface', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:09Z', 'updated_at': '2021-05-31T16:21:20Z', 'revision_number': 5, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'subnets': [{'id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:25:23.187438 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62874174-d90b-4624-bc1f-565f0cebcf17 req-529c9560-bf43-4283-8418-f19580f5339a tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:23.188997 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-62874174-d90b-4624-bc1f-565f0cebcf17 req-529c9560-bf43-4283-8418-f19580f5339a tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 945 time: 0.1721144
May 31 16:25:23.197607 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-553e6bcc-4023-4509-beb7-85da1d05410a req-0493ceaa-f590-40d5-8689-02ca3a3e787e tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1973905508&fields=id&tenant_id=092115f69b8e401b8c334f7b3e797aad HTTP/1.1" status: 200  len: 267 time: 0.0991919
May 31 16:25:23.323213 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-62874174-d90b-4624-bc1f-565f0cebcf17 req-09afb2e5-0b0d-4294-bc13-7fcd97b72616 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/security-groups?id=b7938be0-8a2c-4f7f-97e1-241934e0bfb0&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1244750
May 31 16:25:23.423106 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-553e6bcc-4023-4509-beb7-85da1d05410a req-a1652eff-3f3a-40c6-bfdc-6f69d8aa808b tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:23.424942 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-553e6bcc-4023-4509-beb7-85da1d05410a req-a1652eff-3f3a-40c6-bfdc-6f69d8aa808b tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/networks?id=5b237728-dc31-4203-bbac-66ce3db1593a HTTP/1.1" status: 200  len: 812 time: 0.2105474
May 31 16:25:23.441947 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-553e6bcc-4023-4509-beb7-85da1d05410a req-33641293-a214-41a9-891e-1281e762b2c9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/quotas/092115f69b8e401b8c334f7b3e797aad HTTP/1.1" status: 200  len: 375 time: 0.0111773
May 31 16:25:23.466040 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69edcced-eb29-4b6b-9b8d-da6d71d268b9 None None] New status for floating IP 3c15c76f-9cda-471e-b526-617f49a22ed5: DOWN {{(pid=91766) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 31 16:25:23.535363 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-553e6bcc-4023-4509-beb7-85da1d05410a req-14212526-d695-4cd3-a142-5d51e4e8685c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=092115f69b8e401b8c334f7b3e797aad&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0872371
May 31 16:25:23.728371 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1ce5a4c-15c9-4ad8-8415-8f2dfb4044b8 req-f78910fe-a34b-4739-bdca-e234b931614a tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:23.729333 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-d1ce5a4c-15c9-4ad8-8415-8f2dfb4044b8 req-f78910fe-a34b-4739-bdca-e234b931614a tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Synchronizing usage tracker for tenant:8f633dd4e3b241db904e4505f98ebe62 on resource:port {{(pid=91763) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:25:23.765484 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-d1ce5a4c-15c9-4ad8-8415-8f2dfb4044b8 req-f78910fe-a34b-4739-bdca-e234b931614a tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Unset dirty status for tenant:8f633dd4e3b241db904e4505f98ebe62 on resource:port {{(pid=91763) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:25:23.767026 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-d1ce5a4c-15c9-4ad8-8415-8f2dfb4044b8 req-f78910fe-a34b-4739-bdca-e234b931614a tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.63 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 945 time: 0.1671925
May 31 16:25:23.975422 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-d1ce5a4c-15c9-4ad8-8415-8f2dfb4044b8 req-cef9e3b0-4040-43a8-a8f3-8a6143d57d75 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Deleting port 487b4be1-d7f8-41ea-9900-c3e035776735 {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:25:23.975872 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-d1ce5a4c-15c9-4ad8-8415-8f2dfb4044b8 req-cef9e3b0-4040-43a8-a8f3-8a6143d57d75 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:24.012729 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-553e6bcc-4023-4509-beb7-85da1d05410a req-888ae824-4c18-4cd9-a100-4bc32e370db1 service neutron] 10.222.0.43 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4601445
May 31 16:25:24.129016 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5ed8545-5be8-4ea6-815e-c0cb2902b8dd req-8138be88-075b-472e-a1d4-6cd302000711 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:24.130520 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b5ed8545-5be8-4ea6-815e-c0cb2902b8dd req-8138be88-075b-472e-a1d4-6cd302000711 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.2711177
May 31 16:25:24.144420 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-d1ce5a4c-15c9-4ad8-8415-8f2dfb4044b8 req-cef9e3b0-4040-43a8-a8f3-8a6143d57d75 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] For port 487b4be1-d7f8-41ea-9900-c3e035776735, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=487b4be1-d7f8-41ea-9900-c3e035776735,segment=NetworkSegment(54d58804-a1bf-4e3a-8d44-cdd8f5cc124a),segment_id=54d58804-a1bf-4e3a-8d44-cdd8f5cc124a)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:25:24.144774 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-d1ce5a4c-15c9-4ad8-8415-8f2dfb4044b8 req-cef9e3b0-4040-43a8-a8f3-8a6143d57d75 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:24.203559 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-553e6bcc-4023-4509-beb7-85da1d05410a req-72323ced-9056-4a5d-ad3f-c259f3179d9c service neutron] 10.222.0.43 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1893129
May 31 16:25:24.216584 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b5ed8545-5be8-4ea6-815e-c0cb2902b8dd req-566d050a-007f-4f1d-8a71-38d1abde248d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0795038
May 31 16:25:24.308869 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-d1ce5a4c-15c9-4ad8-8415-8f2dfb4044b8 req-cef9e3b0-4040-43a8-a8f3-8a6143d57d75 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Calling delete_port for 487b4be1-d7f8-41ea-9900-c3e035776735 owned by compute:nova {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:25:24.437115 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-d1ce5a4c-15c9-4ad8-8415-8f2dfb4044b8 req-cef9e3b0-4040-43a8-a8f3-8a6143d57d75 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:24.444446 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:24.458252 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['487b4be1-d7f8-41ea-9900-c3e035776735'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:25:24.499166 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cef9e3b0-4040-43a8-a8f3-8a6143d57d75 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Pushing event deleted for resources: {'Port': ['ID=487b4be1-d7f8-41ea-9900-c3e035776735,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:24.508300 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-cef9e3b0-4040-43a8-a8f3-8a6143d57d75 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:24.551312 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8096732b-e37d-4c11-9bcc-d9502c99c370 req-a6a51cd3-27d3-46b8-8ef8-42a70271a357 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.43 "GET /v2.0/ports?device_id=899e9d5a-164d-478b-b9ff-812d895117bf HTTP/1.1" status: 200  len: 210 time: 0.0569179
May 31 16:25:24.591963 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [req-d1ce5a4c-15c9-4ad8-8415-8f2dfb4044b8 req-cef9e3b0-4040-43a8-a8f3-8a6143d57d75 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] No DVR routers for this DVR port 487b4be1-d7f8-41ea-9900-c3e035776735 on host hv-cinder-79381 {{(pid=91763) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:25:24.594640 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-d1ce5a4c-15c9-4ad8-8415-8f2dfb4044b8 req-cef9e3b0-4040-43a8-a8f3-8a6143d57d75 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:24.597829 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '899e9d5a-164d-478b-b9ff-812d895117bf', 'name': 'network-vif-deleted', 'tag': '487b4be1-d7f8-41ea-9900-c3e035776735'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:25:24.600147 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-adfada80-a41c-439f-b365-9d10b6db6451" -d '{"events": [{"server_uuid": "899e9d5a-164d-478b-b9ff-812d895117bf", "name": "network-vif-deleted", "tag": "487b4be1-d7f8-41ea-9900-c3e035776735"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:25:24.617337 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-d1ce5a4c-15c9-4ad8-8415-8f2dfb4044b8 req-cef9e3b0-4040-43a8-a8f3-8a6143d57d75 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] 10.222.0.63 "DELETE /v2.0/ports/487b4be1-d7f8-41ea-9900-c3e035776735 HTTP/1.1" status: 204  len: 173 time: 0.8413858
May 31 16:25:24.811114 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-88532dd3-b745-4dd2-9604-3e508213417d req-9a9d44ed-cd3a-4379-bd21-ddfe63875b0e tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 210 time: 0.0589612
May 31 16:25:24.851248 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:25:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-97f72b04-0bf6-45e2-9e5c-0c3c5c2bf5c3 x-openstack-request-id: req-97f72b04-0bf6-45e2-9e5c-0c3c5c2bf5c3 {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:25:24.851812 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "899e9d5a-164d-478b-b9ff-812d895117bf", "name": "network-vif-deleted", "tag": "487b4be1-d7f8-41ea-9900-c3e035776735", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:25:24.851974 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-97f72b04-0bf6-45e2-9e5c-0c3c5c2bf5c3 {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:25:24.852511 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '899e9d5a-164d-478b-b9ff-812d895117bf', 'name': 'network-vif-deleted', 'tag': '487b4be1-d7f8-41ea-9900-c3e035776735', 'status': 'completed', 'code': 200}
May 31 16:25:25.465691 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd9040e8-fae7-443e-9efb-49af44362883 req-713d9eba-c7ba-4dfa-b5e8-c03b0b382ae2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:25.467324 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bd9040e8-fae7-443e-9efb-49af44362883 req-713d9eba-c7ba-4dfa-b5e8-c03b0b382ae2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.1133080
May 31 16:25:25.522204 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bd9040e8-fae7-443e-9efb-49af44362883 req-cf1754c8-4db8-4d05-a455-076394a55f49 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0483477
May 31 16:25:25.629052 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 35728) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:25.718679 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43295c4b-987f-4df8-9242-03d14831ea20 req-6b361f5d-b0de-43aa-82e8-a19c71016ca0 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:25.721256 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-43295c4b-987f-4df8-9242-03d14831ea20 req-6b361f5d-b0de-43aa-82e8-a19c71016ca0 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.0846117
May 31 16:25:25.731688 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 35738) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:25.738529 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-8b230562-4936-446a-8585-d93d83b8eda2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Request body: {'floatingip': {'port_id': '49427db6-0261-4969-89c1-47664fa8a818'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:25:25.829403 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:25.858202 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8b230562-4936-446a-8585-d93d83b8eda2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for floatingip, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:25.927002 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:25:26.096641 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3b24564d-7a9b-4541-97af-111078dac09c req-5856c5f1-10e0-4a15-9430-7fd7c0ca068c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 210 time: 0.1705346
May 31 16:25:26.101029 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Usage tracker for resource:security_group_rule and tenant:a0dd02a9ffc74303ae65b33e723fa3d2 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:25:26.144646 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:25:26.216914 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:25:26.453473 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-553e6bcc-4023-4509-beb7-85da1d05410a req-025d2953-f97e-4aaa-8a30-11942c4e3514 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:26.454106 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-553e6bcc-4023-4509-beb7-85da1d05410a req-025d2953-f97e-4aaa-8a30-11942c4e3514 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Synchronizing usage tracker for tenant:092115f69b8e401b8c334f7b3e797aad on resource:network {{(pid=91763) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:25:26.568476 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-553e6bcc-4023-4509-beb7-85da1d05410a req-025d2953-f97e-4aaa-8a30-11942c4e3514 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Unset dirty status for tenant:092115f69b8e401b8c334f7b3e797aad on resource:network {{(pid=91763) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:25:26.569650 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-553e6bcc-4023-4509-beb7-85da1d05410a req-025d2953-f97e-4aaa-8a30-11942c4e3514 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.63 "GET /v2.0/networks?id=5b237728-dc31-4203-bbac-66ce3db1593a HTTP/1.1" status: 200  len: 812 time: 0.6402135
May 31 16:25:26.617474 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:26.628745 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:26.638741 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-7424d25d-ffcd-4431-9071-7638e8cd2864 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:26.751002 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6967b60e-b2c2-4e8e-81fd-6473a4338aef tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Synchronizing usage tracker for tenant:092115f69b8e401b8c334f7b3e797aad on resource:security_group {{(pid=91763) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:25:26.781876 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=a0dd02a9ffc74303ae65b33e723fa3d2&name=default HTTP/1.1" status: 200  len: 2979 time: 1.1491621
May 31 16:25:26.782342 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 35748) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:26.791179 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=95b3b78d-70be-4458-9b0a-8c2c675096b2,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:26.812890 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:26.813273 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:26.813682 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:26.814143 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:26.814584 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:26.814967 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:26.815357 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:26.815723 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:26.816045 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:26.816401 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:26.816754 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:26.817102 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:26.823122 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:26.825761 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6967b60e-b2c2-4e8e-81fd-6473a4338aef tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Unset dirty status for tenant:092115f69b8e401b8c334f7b3e797aad on resource:security_group {{(pid=91763) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:25:26.826929 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6967b60e-b2c2-4e8e-81fd-6473a4338aef tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.63 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=092115f69b8e401b8c334f7b3e797aad HTTP/1.1" status: 200  len: 380 time: 0.2333634
May 31 16:25:26.847413 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [req-553e6bcc-4023-4509-beb7-85da1d05410a req-48badd7a-5826-474c-9462-96f5cd157cb0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Request body: {'port': {'device_id': '4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'admin_state_up': True, 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'security_groups': ['b16a6ce7-d949-48d8-8c08-03576b09b2e8']}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:25:26.857970 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-9357b9a4-e196-4f31-8601-719e4274b04b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:26.895547 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-9357b9a4-e196-4f31-8601-719e4274b04b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:26.965300 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-9357b9a4-e196-4f31-8601-719e4274b04b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:26.971018 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-01129fde-ea47-4699-8a49-bbc103648295 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:26.982783 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9357b9a4-e196-4f31-8601-719e4274b04b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=95b3b78d-70be-4458-9b0a-8c2c675096b2,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:26.990377 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-9357b9a4-e196-4f31-8601-719e4274b04b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:26.997681 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-9357b9a4-e196-4f31-8601-719e4274b04b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:26.998935 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-9357b9a4-e196-4f31-8601-719e4274b04b admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/95b3b78d-70be-4458-9b0a-8c2c675096b2 HTTP/1.1" status: 204  len: 168 time: 0.2145998
May 31 16:25:27.090235 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [req-553e6bcc-4023-4509-beb7-85da1d05410a req-48badd7a-5826-474c-9462-96f5cd157cb0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:25:27.104078 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-553e6bcc-4023-4509-beb7-85da1d05410a req-48badd7a-5826-474c-9462-96f5cd157cb0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Usage tracker for resource:port and tenant:092115f69b8e401b8c334f7b3e797aad is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:25:27.109112 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-553e6bcc-4023-4509-beb7-85da1d05410a req-48badd7a-5826-474c-9462-96f5cd157cb0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Quota usage for port was recalculated. Used quota:3. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:25:27.118302 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [req-553e6bcc-4023-4509-beb7-85da1d05410a req-48badd7a-5826-474c-9462-96f5cd157cb0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:25:27.128637 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8b230562-4936-446a-8585-d93d83b8eda2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:27.133040 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8b230562-4936-446a-8585-d93d83b8eda2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16621821'] for floatingip, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:27.187621 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-553e6bcc-4023-4509-beb7-85da1d05410a req-48badd7a-5826-474c-9462-96f5cd157cb0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Made reservation on behalf of 092115f69b8e401b8c334f7b3e797aad for: {'port': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:25:27.191612 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-553e6bcc-4023-4509-beb7-85da1d05410a req-48badd7a-5826-474c-9462-96f5cd157cb0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:27.324548 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-097081d0-e3d0-4311-89c4-bbe3ce7e16d0 req-08807d92-960e-469e-8c4c-dcc53525bd7d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 210 time: 0.0736573
May 31 16:25:27.363202 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 35764) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:27.385412 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-50b0bbb8-b8b8-4754-a94a-9c358eb771bb admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:27.400972 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-50b0bbb8-b8b8-4754-a94a-9c358eb771bb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:25:27.403187 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.l3_db [None req-8b230562-4936-446a-8585-d93d83b8eda2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Floating IP 06133069-c955-49dc-b4bc-d10700328eb1 associated. External IP: 172.27.0.216, port: 49427db6-0261-4969-89c1-47664fa8a818.
May 31 16:25:27.404916 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-50b0bbb8-b8b8-4754-a94a-9c358eb771bb admin admin] Usage tracker for resource:security_group_rule and tenant:00bdcb60827f43d1b98591f66c329568 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:25:27.407914 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-50b0bbb8-b8b8-4754-a94a-9c358eb771bb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:25:27.414769 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-50b0bbb8-b8b8-4754-a94a-9c358eb771bb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:25:27.507194 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-50b0bbb8-b8b8-4754-a94a-9c358eb771bb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:27.512357 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-50b0bbb8-b8b8-4754-a94a-9c358eb771bb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:27.521388 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-9357b9a4-e196-4f31-8601-719e4274b04b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:27.587012 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-50b0bbb8-b8b8-4754-a94a-9c358eb771bb admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=00bdcb60827f43d1b98591f66c329568&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2198830
May 31 16:25:27.587012 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50b0bbb8-b8b8-4754-a94a-9c358eb771bb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a4262d7f-2f34-4b99-a8f5-a27acea16fc2,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:27.589020 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-50b0bbb8-b8b8-4754-a94a-9c358eb771bb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:27.589689 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 35770) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:27.660139 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f920c3a0-0e21-4f8e-988c-01e31e1199b6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:27.689458 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f920c3a0-0e21-4f8e-988c-01e31e1199b6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:27.727019 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [req-553e6bcc-4023-4509-beb7-85da1d05410a req-48badd7a-5826-474c-9462-96f5cd157cb0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Allocated IP 172.20.0.4 (5b237728-dc31-4203-bbac-66ce3db1593a/995d9a2e-7e88-458e-9385-d135c0e07276/31d7a0be-14fe-4eee-8a37-db20d72be4ab) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:25:27.742429 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f920c3a0-0e21-4f8e-988c-01e31e1199b6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:27.748902 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-a1d331fd-c1a4-477f-bd95-0713e7ebc863 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:27.770136 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f920c3a0-0e21-4f8e-988c-01e31e1199b6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a4262d7f-2f34-4b99-a8f5-a27acea16fc2,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:27.772938 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-f920c3a0-0e21-4f8e-988c-01e31e1199b6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:27.774159 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f920c3a0-0e21-4f8e-988c-01e31e1199b6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:27.775610 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-f920c3a0-0e21-4f8e-988c-01e31e1199b6 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/a4262d7f-2f34-4b99-a8f5-a27acea16fc2 HTTP/1.1" status: 204  len: 168 time: 0.1843791
May 31 16:25:27.791556 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 487b4be1-d7f8-41ea-9900-c3e035776735 no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:25:27.836892 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] No Port match for: 487b4be1-d7f8-41ea-9900-c3e035776735 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:25:27.837340 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 487b4be1-d7f8-41ea-9900-c3e035776735 not bound to the agent host hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:25:28.104645 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-553e6bcc-4023-4509-beb7-85da1d05410a req-48badd7a-5826-474c-9462-96f5cd157cb0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:28.108750 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8b230562-4936-446a-8585-d93d83b8eda2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Router 8471b167-8540-4806-9932-e05fcb75a12b has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91763) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:25:28.128524 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.provisioning_blocks [req-553e6bcc-4023-4509-beb7-85da1d05410a req-48badd7a-5826-474c-9462-96f5cd157cb0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Transition to ACTIVE for port object 31d7a0be-14fe-4eee-8a37-db20d72be4ab will not be triggered until provisioned by entity DHCP. {{(pid=91763) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:25:28.312011 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-553e6bcc-4023-4509-beb7-85da1d05410a req-48badd7a-5826-474c-9462-96f5cd157cb0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:28.319840 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-0f3d8a25-7712-47e0-aa06-41b2cac1c3d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:28.371061 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8b230562-4936-446a-8585-d93d83b8eda2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:25:28.389118 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae9afb1c-9b90-4eeb-adc2-08290ea3c7f6 None None] Sync routers for ids ['8471b167-8540-4806-9932-e05fcb75a12b'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:25:28.400709 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-553e6bcc-4023-4509-beb7-85da1d05410a req-48badd7a-5826-474c-9462-96f5cd157cb0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Network 5b237728-dc31-4203-bbac-66ce3db1593a is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:25:28.406761 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [req-553e6bcc-4023-4509-beb7-85da1d05410a req-48badd7a-5826-474c-9462-96f5cd157cb0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:25:28.412895 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [req-553e6bcc-4023-4509-beb7-85da1d05410a req-48badd7a-5826-474c-9462-96f5cd157cb0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:25:28.416102 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae9afb1c-9b90-4eeb-adc2-08290ea3c7f6 None None] Routers {'8471b167-8540-4806-9932-e05fcb75a12b'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:25:28.416262 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-ae9afb1c-9b90-4eeb-adc2-08290ea3c7f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f14260caf40>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:25:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['8471b167-8540-4806-9932-e05fcb75a12b'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:28.442012 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48badd7a-5826-474c-9462-96f5cd157cb0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Pushing event updated for resources: {'Port': ['ID=31d7a0be-14fe-4eee-8a37-db20d72be4ab,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:28.449880 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-48badd7a-5826-474c-9462-96f5cd157cb0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:28.473402 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-8b230562-4936-446a-8585-d93d83b8eda2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for floatingip, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:28.546289 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-8b230562-4936-446a-8585-d93d83b8eda2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "PUT /v2.0/floatingips/06133069-c955-49dc-b4bc-d10700328eb1 HTTP/1.1" status: 200  len: 992 time: 2.8132527
May 31 16:25:28.559562 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '61f2d7a8-c7cd-4a2d-9a17-4654f91ad264', 'tag': '49427db6-0261-4969-89c1-47664fa8a818'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:25:28.562282 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e665f619-0e8e-4c3e-b78c-f2ca41e92438" -d '{"events": [{"name": "network-changed", "server_uuid": "61f2d7a8-c7cd-4a2d-9a17-4654f91ad264", "tag": "49427db6-0261-4969-89c1-47664fa8a818"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:25:28.571909 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-553e6bcc-4023-4509-beb7-85da1d05410a req-48badd7a-5826-474c-9462-96f5cd157cb0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:28.572826 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-553e6bcc-4023-4509-beb7-85da1d05410a req-48badd7a-5826-474c-9462-96f5cd157cb0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:28.614592 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-553e6bcc-4023-4509-beb7-85da1d05410a req-48badd7a-5826-474c-9462-96f5cd157cb0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.63 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.7609694
May 31 16:25:28.707019 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1c19147-e00b-4394-a4e2-08300cc60cf0 req-73925abe-a6c7-456b-981b-57d030d59909 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:28.709416 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a1c19147-e00b-4394-a4e2-08300cc60cf0 req-73925abe-a6c7-456b-981b-57d030d59909 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 931 time: 0.2573183
May 31 16:25:28.712324 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-ae9afb1c-9b90-4eeb-adc2-08290ea3c7f6 None None] Set router 8471b167-8540-4806-9932-e05fcb75a12b gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:25:28.759795 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a1c19147-e00b-4394-a4e2-08300cc60cf0 req-44c52ff2-4127-4b53-9ad2-f7d8e49457f5 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0436511
May 31 16:25:28.871263 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-039d1695-be5e-48a1-a78a-bf5b41dc015b None None] Provisioning for port 31d7a0be-14fe-4eee-8a37-db20d72be4ab completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:25:28.878940 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-039d1695-be5e-48a1-a78a-bf5b41dc015b None None] Provisioning complete for port 31d7a0be-14fe-4eee-8a37-db20d72be4ab triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:25:28.879389 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-039d1695-be5e-48a1-a78a-bf5b41dc015b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:28.961127 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-039d1695-be5e-48a1-a78a-bf5b41dc015b None None] Port 31d7a0be-14fe-4eee-8a37-db20d72be4ab cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:25:29.139601 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-ae9afb1c-9b90-4eeb-adc2-08290ea3c7f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f14260caf40>, [{'id': '8471b167-8540-4806-9932-e05fcb75a12b', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:55Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '12203182731d4a61acb7fc5914aef425', 'gw_port': {'id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:83:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:19:56Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': '06133069-c955-49dc-b4bc-d10700328eb1', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'floating_ip_address': '172.27.0.216', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'port_id': '49427db6-0261-4969-89c1-47664fa8a818', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 500, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'mac_address': 'fa:16:3e:ca:d5:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '61f2d7a8-c7cd-4a2d-9a17-4654f91ad264', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:25:03Z', 'updated_at': '2021-05-31T16:25:26Z', 'revision_number': 1, 'project_id': '12203182731d4a61acb7fc5914aef425', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'db126eb4-e252-4765-86f1-09d3f20549df', 'name': '', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'mac_address': 'fa:16:3e:63:bd:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:04Z', 'updated_at': '2021-05-31T16:20:20Z', 'revision_number': 5, 'project_id': '12203182731d4a61acb7fc5914aef425', 'subnets': [{'id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:29.144317 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae9afb1c-9b90-4eeb-adc2-08290ea3c7f6 None None] Checking router: 8471b167-8540-4806-9932-e05fcb75a12b for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:25:29.153075 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae9afb1c-9b90-4eeb-adc2-08290ea3c7f6 None None] Routers {'8471b167-8540-4806-9932-e05fcb75a12b'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:25:29.153808 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-ae9afb1c-9b90-4eeb-adc2-08290ea3c7f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f14260caf40>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:25:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['8471b167-8540-4806-9932-e05fcb75a12b'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:29.346098 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-ae9afb1c-9b90-4eeb-adc2-08290ea3c7f6 None None] Set router 8471b167-8540-4806-9932-e05fcb75a12b gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:25:29.703727 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-ae9afb1c-9b90-4eeb-adc2-08290ea3c7f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f14260caf40>, [{'id': '8471b167-8540-4806-9932-e05fcb75a12b', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:55Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '12203182731d4a61acb7fc5914aef425', 'gw_port': {'id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:83:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:19:56Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': '06133069-c955-49dc-b4bc-d10700328eb1', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'floating_ip_address': '172.27.0.216', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'port_id': '49427db6-0261-4969-89c1-47664fa8a818', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 500, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'mac_address': 'fa:16:3e:ca:d5:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '61f2d7a8-c7cd-4a2d-9a17-4654f91ad264', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:25:03Z', 'updated_at': '2021-05-31T16:25:26Z', 'revision_number': 1, 'project_id': '12203182731d4a61acb7fc5914aef425', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'db126eb4-e252-4765-86f1-09d3f20549df', 'name': '', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'mac_address': 'fa:16:3e:63:bd:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:04Z', 'updated_at': '2021-05-31T16:20:20Z', 'revision_number': 5, 'project_id': '12203182731d4a61acb7fc5914aef425', 'subnets': [{'id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:29.708394 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae9afb1c-9b90-4eeb-adc2-08290ea3c7f6 None None] The sync data for ids ['8471b167-8540-4806-9932-e05fcb75a12b'] in dv-cinder-793814-1-iscsi is: [{'id': '8471b167-8540-4806-9932-e05fcb75a12b', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:55Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '12203182731d4a61acb7fc5914aef425', 'gw_port': {'id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:83:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:19:56Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': '06133069-c955-49dc-b4bc-d10700328eb1', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'floating_ip_address': '172.27.0.216', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'port_id': '49427db6-0261-4969-89c1-47664fa8a818', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 500, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'mac_address': 'fa:16:3e:ca:d5:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '61f2d7a8-c7cd-4a2d-9a17-4654f91ad264', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:25:03Z', 'updated_at': '2021-05-31T16:25:26Z', 'revision_number': 1, 'project_id': '12203182731d4a61acb7fc5914aef425', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'db126eb4-e252-4765-86f1-09d3f20549df', 'name': '', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'mac_address': 'fa:16:3e:63:bd:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:04Z', 'updated_at': '2021-05-31T16:20:20Z', 'revision_number': 5, 'project_id': '12203182731d4a61acb7fc5914aef425', 'subnets': [{'id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:25:29.898625 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41ed99d7-a619-4112-9320-22f1217e4297 None None] New status for floating IP 06133069-c955-49dc-b4bc-d10700328eb1: ACTIVE {{(pid=91766) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 31 16:25:30.875016 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Request body: {'port': {'device_id': '4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79381'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:25:31.012946 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:31.100874 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:25:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1c265fec-93b1-415a-9f59-8c166a792343 x-openstack-request-id: req-1c265fec-93b1-415a-9f59-8c166a792343 {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:25:31.101210 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "61f2d7a8-c7cd-4a2d-9a17-4654f91ad264", "tag": "49427db6-0261-4969-89c1-47664fa8a818", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:25:31.101497 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-1c265fec-93b1-415a-9f59-8c166a792343 {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:25:31.101955 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '61f2d7a8-c7cd-4a2d-9a17-4654f91ad264', 'tag': '49427db6-0261-4969-89c1-47664fa8a818', 'status': 'completed', 'code': 200}
May 31 16:25:31.107332 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b7a1971-ff64-4a8c-a89b-5d23d6e7713b req-01e8021b-55e4-4462-b8cb-8da0a35d8728 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:31.109002 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1b7a1971-ff64-4a8c-a89b-5d23d6e7713b req-01e8021b-55e4-4462-b8cb-8da0a35d8728 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 931 time: 0.0918913
May 31 16:25:31.176224 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:25:31.256993 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1b7a1971-ff64-4a8c-a89b-5d23d6e7713b req-cd730461-ce99-429d-a3e2-46111afc6715 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1327021
May 31 16:25:31.284507 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-50e9ea2e-7294-490e-848e-c5cec87038c9 req-0ee86939-c959-4487-ba8e-b98351fe4ed2 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1685154645&fields=id&tenant_id=8e66b29e29094a429643e0308704753b HTTP/1.1" status: 200  len: 267 time: 0.0821438
May 31 16:25:31.332628 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e665f619-0e8e-4c3e-b78c-f2ca41e92438 req-2f3abd40-60f6-4488-a077-1e0c0128e32a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:31.334197 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e665f619-0e8e-4c3e-b78c-f2ca41e92438 req-2f3abd40-60f6-4488-a077-1e0c0128e32a service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=12203182731d4a61acb7fc5914aef425&device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 1099 time: 0.1935992
May 31 16:25:31.397878 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 31d7a0be-14fe-4eee-8a37-db20d72be4ab {{(pid=91763) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:25:31.405365 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:31.419472 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.provisioning_blocks [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Transition to ACTIVE for port object 31d7a0be-14fe-4eee-8a37-db20d72be4ab will not be triggered until provisioned by entity L2. {{(pid=91763) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:25:31.425348 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14337082'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:31.429007 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-cef9e3b0-4040-43a8-a8f3-8a6143d57d75 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:31.506853 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50e9ea2e-7294-490e-848e-c5cec87038c9 req-fa3ffcd3-725a-44d1-a805-17c5304e4eb4 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:31.508423 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-50e9ea2e-7294-490e-848e-c5cec87038c9 req-fa3ffcd3-725a-44d1-a805-17c5304e4eb4 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 984 time: 0.2169039
May 31 16:25:31.509485 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e665f619-0e8e-4c3e-b78c-f2ca41e92438 req-adadae2c-6e56-4e53-8204-952b0f555018 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:31.510795 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e665f619-0e8e-4c3e-b78c-f2ca41e92438 req-adadae2c-6e56-4e53-8204-952b0f555018 service neutron] 10.222.0.63 "GET /v2.0/networks?id=be7d7603-734f-43bb-92a8-ed07a835aeb5 HTTP/1.1" status: 200  len: 917 time: 0.1655285
May 31 16:25:31.522278 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-50e9ea2e-7294-490e-848e-c5cec87038c9 req-2c9f4e53-fc85-4f83-9079-071f8403eb25 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Request body: {'port': {'security_groups': ['36428dc9-0862-4d53-8a33-6b298f5353c7']}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:25:31.562138 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Pushing event updated for resources: {'Port': ['ID=31d7a0be-14fe-4eee-8a37-db20d72be4ab,revision_number=2']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:31.589373 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:31.745785 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e665f619-0e8e-4c3e-b78c-f2ca41e92438 req-fadb2691-8e77-43e2-ad0a-d605456b8d96 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=49427db6-0261-4969-89c1-47664fa8a818 HTTP/1.1" status: 200  len: 1002 time: 0.1914530
May 31 16:25:31.791674 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Attempting to bind port 31d7a0be-14fe-4eee-8a37-db20d72be4ab on host hv-cinder-79381 for vnic_type normal with profile  {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:25:31.792018 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Attempting to bind port 31d7a0be-14fe-4eee-8a37-db20d72be4ab by drivers openvswitch,hyperv on host hv-cinder-79381 at level 0 using segments [{'id': 'fb1fd409-498f-4f29-82bc-1d244a7a3ed1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a'}] {{(pid=91763) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:25:31.792456 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Attempting to bind port 31d7a0be-14fe-4eee-8a37-db20d72be4ab on network 5b237728-dc31-4203-bbac-66ce3db1593a {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:25:31.795924 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-50e9ea2e-7294-490e-848e-c5cec87038c9 req-2c9f4e53-fc85-4f83-9079-071f8403eb25 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:31.797366 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Port 31d7a0be-14fe-4eee-8a37-db20d72be4ab on network 5b237728-dc31-4203-bbac-66ce3db1593a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79381 {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 31 16:25:31.798333 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Attempting to bind port 31d7a0be-14fe-4eee-8a37-db20d72be4ab on network 5b237728-dc31-4203-bbac-66ce3db1593a {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:25:31.804063 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Checking agent: {'id': '4bed2638-4d91-4afb-bf81-aacca8584621', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79381', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'started_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 25, 20), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:25:31.804561 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Checking segment: {'id': 'fb1fd409-498f-4f29-82bc-1d244a7a3ed1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91763) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:25:31.804836 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Bound using segment: {'id': 'fb1fd409-498f-4f29-82bc-1d244a7a3ed1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a'} {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:25:31.805275 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Bound port: 31d7a0be-14fe-4eee-8a37-db20d72be4ab, host: hv-cinder-79381, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fb1fd409-498f-4f29-82bc-1d244a7a3ed1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 805, 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a'}}] {{(pid=91763) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:25:31.805666 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:31.895761 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e665f619-0e8e-4c3e-b78c-f2ca41e92438 req-71b3d0b3-a919-4849-85dc-3ae576e9ea32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:31.897303 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e665f619-0e8e-4c3e-b78c-f2ca41e92438 req-71b3d0b3-a919-4849-85dc-3ae576e9ea32 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=eb5363fe-ee39-4adc-b299-6098caad681d HTTP/1.1" status: 200  len: 855 time: 0.1389618
May 31 16:25:31.928733 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] For port 31d7a0be-14fe-4eee-8a37-db20d72be4ab, host hv-cinder-79381, cleared binding levels {{(pid=91763) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:25:31.932812 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] For port 31d7a0be-14fe-4eee-8a37-db20d72be4ab, host hv-cinder-79381, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=31d7a0be-14fe-4eee-8a37-db20d72be4ab,segment=NetworkSegment(fb1fd409-498f-4f29-82bc-1d244a7a3ed1),segment_id=fb1fd409-498f-4f29-82bc-1d244a7a3ed1)] {{(pid=91763) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:25:31.937758 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14337082'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:31.942723 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-8760a860-81ee-40ff-81fa-d9c0fba16fa9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:32.025672 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Pushing event updated for resources: {'Port': ['ID=31d7a0be-14fe-4eee-8a37-db20d72be4ab,revision_number=3']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:32.029514 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:32.041913 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:32.043535 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:32.045782 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-553e6bcc-4023-4509-beb7-85da1d05410a req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] 10.222.0.63 "PUT /v2.0/ports/31d7a0be-14fe-4eee-8a37-db20d72be4ab HTTP/1.1" status: 200  len: 1093 time: 1.1754947
May 31 16:25:32.262827 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-553e6bcc-4023-4509-beb7-85da1d05410a req-7ed458b7-41cd-4c45-bf2f-e50db76c509b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:32.264894 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-553e6bcc-4023-4509-beb7-85da1d05410a req-7ed458b7-41cd-4c45-bf2f-e50db76c509b service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=092115f69b8e401b8c334f7b3e797aad&device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 1096 time: 0.1577017
May 31 16:25:32.319126 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-50e9ea2e-7294-490e-848e-c5cec87038c9 req-2c9f4e53-fc85-4f83-9079-071f8403eb25 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] For port 747cd83a-69bc-48d9-8ba9-e9638b7be825, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=747cd83a-69bc-48d9-8ba9-e9638b7be825,segment=NetworkSegment(44700c9f-b523-4212-86eb-cc7308ee0431),segment_id=44700c9f-b523-4212-86eb-cc7308ee0431)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:25:32.352844 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-50e9ea2e-7294-490e-848e-c5cec87038c9 req-2c9f4e53-fc85-4f83-9079-071f8403eb25 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for port, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:32.355669 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-553e6bcc-4023-4509-beb7-85da1d05410a req-14940416-b804-4442-9343-ac056b646ce8 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=31d7a0be-14fe-4eee-8a37-db20d72be4ab HTTP/1.1" status: 200  len: 217 time: 0.0754056
May 31 16:25:32.360836 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-50e9ea2e-7294-490e-848e-c5cec87038c9 req-2c9f4e53-fc85-4f83-9079-071f8403eb25 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:32.371993 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-3327bf9c-885e-4e31-a7b0-ab890653a077 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:32.374394 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['747cd83a-69bc-48d9-8ba9-e9638b7be825'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:25:32.426358 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50e9ea2e-7294-490e-848e-c5cec87038c9 req-2c9f4e53-fc85-4f83-9079-071f8403eb25 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:32.426618 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-50e9ea2e-7294-490e-848e-c5cec87038c9 req-2c9f4e53-fc85-4f83-9079-071f8403eb25 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:32.427920 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-50e9ea2e-7294-490e-848e-c5cec87038c9 req-2c9f4e53-fc85-4f83-9079-071f8403eb25 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "PUT /v2.0/ports/747cd83a-69bc-48d9-8ba9-e9638b7be825 HTTP/1.1" status: 200  len: 942 time: 0.9116826
May 31 16:25:32.428443 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1d2436ad-b7ce-4d4c-851a-544a84fe2ef5', 'tag': '747cd83a-69bc-48d9-8ba9-e9638b7be825'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:25:32.431069 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee3e4a82-c33c-485e-9131-8b01b812a34b" -d '{"events": [{"name": "network-changed", "server_uuid": "1d2436ad-b7ce-4d4c-851a-544a84fe2ef5", "tag": "747cd83a-69bc-48d9-8ba9-e9638b7be825"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:25:32.442220 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 35894) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:32.474729 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e665f619-0e8e-4c3e-b78c-f2ca41e92438 req-bbca3b16-2025-4063-9e00-2f93a9442e34 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:32.476129 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e665f619-0e8e-4c3e-b78c-f2ca41e92438 req-bbca3b16-2025-4063-9e00-2f93a9442e34 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=be7d7603-734f-43bb-92a8-ed07a835aeb5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.5549548
May 31 16:25:32.525596 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-553e6bcc-4023-4509-beb7-85da1d05410a req-7ff7f92d-4bd1-4f48-b059-00786e88b2c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:32.530189 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-553e6bcc-4023-4509-beb7-85da1d05410a req-7ff7f92d-4bd1-4f48-b059-00786e88b2c7 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=995d9a2e-7e88-458e-9385-d135c0e07276 HTTP/1.1" status: 200  len: 851 time: 0.1669033
May 31 16:25:32.534648 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['747cd83a-69bc-48d9-8ba9-e9638b7be825'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:25:32.690881 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-553e6bcc-4023-4509-beb7-85da1d05410a req-ee1365e0-df02-406a-b6df-3e8baecdd270 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:32.692517 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-553e6bcc-4023-4509-beb7-85da1d05410a req-ee1365e0-df02-406a-b6df-3e8baecdd270 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=5b237728-dc31-4203-bbac-66ce3db1593a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1555955
May 31 16:25:32.869998 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:25:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c3a17e3a-0512-4b8a-8ff7-c3f45cfa734a x-openstack-request-id: req-c3a17e3a-0512-4b8a-8ff7-c3f45cfa734a {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:25:32.870418 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1d2436ad-b7ce-4d4c-851a-544a84fe2ef5", "tag": "747cd83a-69bc-48d9-8ba9-e9638b7be825", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:25:32.870748 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-c3a17e3a-0512-4b8a-8ff7-c3f45cfa734a {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:25:32.871232 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1d2436ad-b7ce-4d4c-851a-544a84fe2ef5', 'tag': '747cd83a-69bc-48d9-8ba9-e9638b7be825', 'status': 'completed', 'code': 200}
May 31 16:25:32.933507 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-de81911d-f675-4c52-9681-9c3191e15000 None None] Provisioning complete for port 747cd83a-69bc-48d9-8ba9-e9638b7be825 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:25:32.933507 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-de81911d-f675-4c52-9681-9c3191e15000 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:32.959933 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-553e6bcc-4023-4509-beb7-85da1d05410a req-82c08237-0271-4ed5-abb6-ba6d6e6606c2 service neutron] 10.222.0.63 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2573731
May 31 16:25:33.010856 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c9f4e53-fc85-4f83-9079-071f8403eb25 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Pushing event updated for resources: {'Port': ['ID=747cd83a-69bc-48d9-8ba9-e9638b7be825,revision_number=7']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:33.015237 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-2c9f4e53-fc85-4f83-9079-071f8403eb25 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.643s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:33.107092 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f9ee75f3-dee4-47c1-8525-28126fbc04a9 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:33.109841 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa', 'tag': '31d7a0be-14fe-4eee-8a37-db20d72be4ab'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:25:33.112401 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9abe762f-8127-40f1-b909-682dfc72f984" -d '{"events": [{"name": "network-changed", "server_uuid": "4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa", "tag": "31d7a0be-14fe-4eee-8a37-db20d72be4ab"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:25:33.123202 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-553e6bcc-4023-4509-beb7-85da1d05410a req-ffdb2620-df9d-4b14-a14e-9a026d6435de service neutron] 10.222.0.63 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1501038
May 31 16:25:33.156873 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e665f619-0e8e-4c3e-b78c-f2ca41e92438 req-e6d4ef42-ba77-442d-9724-376e8ce56870 service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5858457
May 31 16:25:33.157389 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:25:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bb9d6049-22ce-46e0-93cc-409181a02c30 x-openstack-request-id: req-bb9d6049-22ce-46e0-93cc-409181a02c30 {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:25:33.157956 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa", "tag": "31d7a0be-14fe-4eee-8a37-db20d72be4ab", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:25:33.158988 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-bb9d6049-22ce-46e0-93cc-409181a02c30 {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:25:33.159531 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa', 'tag': '31d7a0be-14fe-4eee-8a37-db20d72be4ab', 'status': 'completed', 'code': 200}
May 31 16:25:33.166137 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f9ee75f3-dee4-47c1-8525-28126fbc04a9 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:33.232477 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5ba6210-5993-4266-9687-11f79e665ad3 req-65b18276-6002-4dbe-97fb-0fe2d3f2e959 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:33.234001 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e5ba6210-5993-4266-9687-11f79e665ad3 req-65b18276-6002-4dbe-97fb-0fe2d3f2e959 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 943 time: 0.7453983
May 31 16:25:33.251233 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee3e4a82-c33c-485e-9131-8b01b812a34b req-d6a8843d-ce48-430c-a037-c4636eec98d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:33.253256 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ee3e4a82-c33c-485e-9131-8b01b812a34b req-d6a8843d-ce48-430c-a037-c4636eec98d4 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=8e66b29e29094a429643e0308704753b&device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 1098 time: 0.3884885
May 31 16:25:33.273181 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9abe762f-8127-40f1-b909-682dfc72f984 req-810be2f9-99de-496a-8a90-ec475b2d3a76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:33.274694 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-9abe762f-8127-40f1-b909-682dfc72f984 req-810be2f9-99de-496a-8a90-ec475b2d3a76 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=092115f69b8e401b8c334f7b3e797aad&device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 1096 time: 0.0795481
May 31 16:25:33.432387 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9abe762f-8127-40f1-b909-682dfc72f984 req-ae315623-0d3b-4a67-b1c7-745fbb498d8c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:33.433903 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-9abe762f-8127-40f1-b909-682dfc72f984 req-ae315623-0d3b-4a67-b1c7-745fbb498d8c service neutron] 10.222.0.63 "GET /v2.0/networks?id=5b237728-dc31-4203-bbac-66ce3db1593a HTTP/1.1" status: 200  len: 913 time: 0.1502306
May 31 16:25:33.463854 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e5ba6210-5993-4266-9687-11f79e665ad3 req-9ba9a11b-7db9-4eb4-825e-b94e8ae0300b tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2190893
May 31 16:25:33.507146 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e665f619-0e8e-4c3e-b78c-f2ca41e92438 req-9b1d3d1b-51c6-432e-87ab-c470fbae4274 service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3210201
May 31 16:25:33.508507 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-9abe762f-8127-40f1-b909-682dfc72f984 req-6e95f045-43f9-4644-8841-3d59341407ce service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=31d7a0be-14fe-4eee-8a37-db20d72be4ab HTTP/1.1" status: 200  len: 217 time: 0.0663934
May 31 16:25:33.520542 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f9ee75f3-dee4-47c1-8525-28126fbc04a9 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:33.528787 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-f920c3a0-0e21-4f8e-988c-01e31e1199b6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:33.544996 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee3e4a82-c33c-485e-9131-8b01b812a34b req-645b7afa-2be3-479b-b688-7635e3374b28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:33.546469 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ee3e4a82-c33c-485e-9131-8b01b812a34b req-645b7afa-2be3-479b-b688-7635e3374b28 service neutron] 10.222.0.63 "GET /v2.0/networks?id=e3df5118-0a40-4a66-b31c-a978a0c899cf HTTP/1.1" status: 200  len: 915 time: 0.2437370
May 31 16:25:33.549592 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9ee75f3-dee4-47c1-8525-28126fbc04a9 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:33.552626 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-f9ee75f3-dee4-47c1-8525-28126fbc04a9 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:33.589716 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9abe762f-8127-40f1-b909-682dfc72f984 req-8eb1fc9d-257b-43a9-aa71-ec3f62935179 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:33.591251 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-9abe762f-8127-40f1-b909-682dfc72f984 req-8eb1fc9d-257b-43a9-aa71-ec3f62935179 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=995d9a2e-7e88-458e-9385-d135c0e07276 HTTP/1.1" status: 200  len: 851 time: 0.0649230
May 31 16:25:33.611860 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f9ee75f3-dee4-47c1-8525-28126fbc04a9 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:33.615463 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-f9ee75f3-dee4-47c1-8525-28126fbc04a9 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "DELETE /v2.0/security-groups/85e92dfc-05f2-4d20-bb2c-46b6ec9ddf78 HTTP/1.1" status: 204  len: 168 time: 1.1671271
May 31 16:25:33.620973 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 35912) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:33.671145 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9abe762f-8127-40f1-b909-682dfc72f984 req-3d1d0119-0f42-4f63-8a2b-c45b68079d2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:33.672612 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-9abe762f-8127-40f1-b909-682dfc72f984 req-3d1d0119-0f42-4f63-8a2b-c45b68079d2c service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=5b237728-dc31-4203-bbac-66ce3db1593a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0736146
May 31 16:25:33.746179 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ee3e4a82-c33c-485e-9131-8b01b812a34b req-643a2c63-979f-4c8a-ade2-c644ed233835 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=747cd83a-69bc-48d9-8ba9-e9638b7be825 HTTP/1.1" status: 200  len: 1001 time: 0.1917231
May 31 16:25:33.809097 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-9abe762f-8127-40f1-b909-682dfc72f984 req-82a32289-000b-4673-a881-e86e0bd7172c service neutron] 10.222.0.63 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1287699
May 31 16:25:33.907747 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee3e4a82-c33c-485e-9131-8b01b812a34b req-cafeb7fc-55a3-4a94-86c8-4101f7f4c675 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:33.910003 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ee3e4a82-c33c-485e-9131-8b01b812a34b req-cafeb7fc-55a3-4a94-86c8-4101f7f4c675 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=1a675b0f-478f-47e0-acdd-51bacffe39b6 HTTP/1.1" status: 200  len: 853 time: 0.1560397
May 31 16:25:33.952675 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-9abe762f-8127-40f1-b909-682dfc72f984 req-2837af73-40b9-4821-af67-791695e6bc25 service neutron] 10.222.0.63 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1336563
May 31 16:25:34.038808 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-325d73d6-6d6e-4914-ab83-d6747d184791 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Deleting port 04cf4a3a-286e-44a1-84ca-5915151b9e43 {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:25:34.039161 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-325d73d6-6d6e-4914-ab83-d6747d184791 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:34.055305 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee3e4a82-c33c-485e-9131-8b01b812a34b req-60b034ff-6d8f-4ead-897f-cd4cb61a88bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:34.056773 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ee3e4a82-c33c-485e-9131-8b01b812a34b req-60b034ff-6d8f-4ead-897f-cd4cb61a88bc service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=e3df5118-0a40-4a66-b31c-a978a0c899cf&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1221282
May 31 16:25:34.267500 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-325d73d6-6d6e-4914-ab83-d6747d184791 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:34.267770 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-325d73d6-6d6e-4914-ab83-d6747d184791 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:34.518232 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-325d73d6-6d6e-4914-ab83-d6747d184791 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Calling delete_port for 04cf4a3a-286e-44a1-84ca-5915151b9e43 owned by network:floatingip {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:25:34.525103 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ee3e4a82-c33c-485e-9131-8b01b812a34b req-392f3dbe-a131-4f58-85b9-8fbfb27bdc4c service neutron] 10.222.0.63 "GET /v2.0/networks/e3df5118-0a40-4a66-b31c-a978a0c899cf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4596531
May 31 16:25:34.751952 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ee3e4a82-c33c-485e-9131-8b01b812a34b req-74a22b9b-5108-4ed6-8e77-d3f62a2348b3 service neutron] 10.222.0.63 "GET /v2.0/networks/e3df5118-0a40-4a66-b31c-a978a0c899cf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2135179
May 31 16:25:34.778977 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71a11f39-5d6b-4b26-b2ff-5fd3b6736202 req-4ceb49a8-d1fc-4f98-8de8-eb0842c98e37 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:34.780353 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-71a11f39-5d6b-4b26-b2ff-5fd3b6736202 req-4ceb49a8-d1fc-4f98-8de8-eb0842c98e37 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 943 time: 0.1640792
May 31 16:25:34.876225 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-71a11f39-5d6b-4b26-b2ff-5fd3b6736202 req-1edf13ab-3656-4a86-9698-a3314018318b tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0889144
May 31 16:25:34.892122 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-325d73d6-6d6e-4914-ab83-d6747d184791 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:34.895355 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:34.938053 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-325d73d6-6d6e-4914-ab83-d6747d184791 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Pushing event deleted for resources: {'Port': ['ID=04cf4a3a-286e-44a1-84ca-5915151b9e43,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:34.942171 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-325d73d6-6d6e-4914-ab83-d6747d184791 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:35.005906 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-39c62aec-0aa7-4e30-8b6a-f2d31507b32e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:35.035830 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-325d73d6-6d6e-4914-ab83-d6747d184791 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks [] for floatingip, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:35.036060 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.db.l3_db [None req-325d73d6-6d6e-4914-ab83-d6747d184791 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Floating IP 0bdaa7f7-9a86-4bcf-a99d-ff3f1902bcc0 disassociated (deleted). External IP: 172.27.0.194, port: 747cd83a-69bc-48d9-8ba9-e9638b7be825.
May 31 16:25:35.416888 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-325d73d6-6d6e-4914-ab83-d6747d184791 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Router 7928d30e-0100-4eb5-9431-cf404997bd15 has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91764) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:25:35.616079 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-325d73d6-6d6e-4914-ab83-d6747d184791 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91764) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:25:35.632002 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d571571-567f-413f-92e6-f1c3b1835050 None None] Sync routers for ids ['7928d30e-0100-4eb5-9431-cf404997bd15'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:25:35.642107 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d571571-567f-413f-92e6-f1c3b1835050 None None] Routers {'7928d30e-0100-4eb5-9431-cf404997bd15'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:25:35.642883 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-1d571571-567f-413f-92e6-f1c3b1835050 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f14266e6f40>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:25:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['7928d30e-0100-4eb5-9431-cf404997bd15'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:35.658375 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-325d73d6-6d6e-4914-ab83-d6747d184791 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for floatingip, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:35.755474 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-325d73d6-6d6e-4914-ab83-d6747d184791 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "DELETE /v2.0/floatingips/0bdaa7f7-9a86-4bcf-a99d-ff3f1902bcc0 HTTP/1.1" status: 204  len: 168 time: 2.1334705
May 31 16:25:35.756874 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1d2436ad-b7ce-4d4c-851a-544a84fe2ef5', 'tag': '747cd83a-69bc-48d9-8ba9-e9638b7be825'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:25:35.759486 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e2f4edb1-9aa6-4125-81e7-6f2de19822cf" -d '{"events": [{"name": "network-changed", "server_uuid": "1d2436ad-b7ce-4d4c-851a-544a84fe2ef5", "tag": "747cd83a-69bc-48d9-8ba9-e9638b7be825"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:25:35.839138 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-1d571571-567f-413f-92e6-f1c3b1835050 None None] Set router 7928d30e-0100-4eb5-9431-cf404997bd15 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:25:35.919981 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:25:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e0525c81-28b4-435f-ae48-d375d59b56b5 x-openstack-request-id: req-e0525c81-28b4-435f-ae48-d375d59b56b5 {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:25:35.920318 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1d2436ad-b7ce-4d4c-851a-544a84fe2ef5", "tag": "747cd83a-69bc-48d9-8ba9-e9638b7be825", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:25:35.920603 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-e0525c81-28b4-435f-ae48-d375d59b56b5 {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:25:35.921039 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1d2436ad-b7ce-4d4c-851a-544a84fe2ef5', 'tag': '747cd83a-69bc-48d9-8ba9-e9638b7be825', 'status': 'completed', 'code': 200}
May 31 16:25:36.152585 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2f4edb1-9aa6-4125-81e7-6f2de19822cf req-2adc2653-4f21-49ee-bfb9-a8f351565f2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:36.154276 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e2f4edb1-9aa6-4125-81e7-6f2de19822cf req-2adc2653-4f21-49ee-bfb9-a8f351565f2c service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=8e66b29e29094a429643e0308704753b&device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 1098 time: 0.2029333
May 31 16:25:36.166260 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15a09d7e-f64f-4a04-8c7b-98f4a5ac599a req-da994622-0e0d-4d5a-8a38-d7a184464dc6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:36.167718 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-15a09d7e-f64f-4a04-8c7b-98f4a5ac599a req-da994622-0e0d-4d5a-8a38-d7a184464dc6 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 943 time: 0.1297066
May 31 16:25:36.269680 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-1d571571-567f-413f-92e6-f1c3b1835050 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f14266e6f40>, [{'id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'name': 'tempest-TestMinimumBasicScenario-134910460-router', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182'}], 'enable_snat': True}, 'gw_port_id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:27Z', 'updated_at': '2021-05-31T16:21:37Z', 'revision_number': 4, 'project_id': '8e66b29e29094a429643e0308704753b', 'gw_port': {'id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:07:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_gateway', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:29Z', 'updated_at': '2021-05-31T16:21:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': 'ec5c850b-3c95-4ae6-869b-87be2055c0aa', 'name': '', 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'mac_address': 'fa:16:3e:cb:c9:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_interface', 'standard_attr_id': 328, 'fixed_ips': [{'subnet_id': '1a675b0f-478f-47e0-acdd-51bacffe39b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:36Z', 'updated_at': '2021-05-31T16:21:45Z', 'revision_number': 5, 'project_id': '8e66b29e29094a429643e0308704753b', 'subnets': [{'id': '1a675b0f-478f-47e0-acdd-51bacffe39b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:36.274829 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d571571-567f-413f-92e6-f1c3b1835050 None None] Checking router: 7928d30e-0100-4eb5-9431-cf404997bd15 for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:25:36.305504 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d571571-567f-413f-92e6-f1c3b1835050 None None] Routers {'7928d30e-0100-4eb5-9431-cf404997bd15'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:25:36.306720 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-1d571571-567f-413f-92e6-f1c3b1835050 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f14266e6f40>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:25:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['7928d30e-0100-4eb5-9431-cf404997bd15'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:36.524721 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-15a09d7e-f64f-4a04-8c7b-98f4a5ac599a req-b4dea8a0-8b84-4064-9731-8a824fd02860 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.3338821
May 31 16:25:36.547123 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2f4edb1-9aa6-4125-81e7-6f2de19822cf req-705ca778-1f1e-477e-ada5-d3b65f5082c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:36.548650 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e2f4edb1-9aa6-4125-81e7-6f2de19822cf req-705ca778-1f1e-477e-ada5-d3b65f5082c3 service neutron] 10.222.0.63 "GET /v2.0/networks?id=e3df5118-0a40-4a66-b31c-a978a0c899cf HTTP/1.1" status: 200  len: 915 time: 0.3799763
May 31 16:25:36.597602 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-1d571571-567f-413f-92e6-f1c3b1835050 None None] Set router 7928d30e-0100-4eb5-9431-cf404997bd15 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:25:36.620890 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e2f4edb1-9aa6-4125-81e7-6f2de19822cf req-0339eda5-74b5-43e4-b8ec-9751f3ad39ac service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=747cd83a-69bc-48d9-8ba9-e9638b7be825 HTTP/1.1" status: 200  len: 217 time: 0.0650697
May 31 16:25:36.684095 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2f4edb1-9aa6-4125-81e7-6f2de19822cf req-7dd6cbfd-fd10-4dee-a512-11a2021f6df5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:36.686012 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e2f4edb1-9aa6-4125-81e7-6f2de19822cf req-7dd6cbfd-fd10-4dee-a512-11a2021f6df5 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=1a675b0f-478f-47e0-acdd-51bacffe39b6 HTTP/1.1" status: 200  len: 853 time: 0.0578926
May 31 16:25:36.777943 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2f4edb1-9aa6-4125-81e7-6f2de19822cf req-398ed39f-9e44-4a00-acae-23488ec80ed4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:36.779451 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e2f4edb1-9aa6-4125-81e7-6f2de19822cf req-398ed39f-9e44-4a00-acae-23488ec80ed4 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=e3df5118-0a40-4a66-b31c-a978a0c899cf&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0806253
May 31 16:25:36.953646 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e2f4edb1-9aa6-4125-81e7-6f2de19822cf req-d00f5cbd-c40d-4221-9e6b-80bb97e87aa5 service neutron] 10.222.0.63 "GET /v2.0/networks/e3df5118-0a40-4a66-b31c-a978a0c899cf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1560907
May 31 16:25:37.047678 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-1d571571-567f-413f-92e6-f1c3b1835050 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f14266e6f40>, [{'id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'name': 'tempest-TestMinimumBasicScenario-134910460-router', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182'}], 'enable_snat': True}, 'gw_port_id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:27Z', 'updated_at': '2021-05-31T16:21:37Z', 'revision_number': 4, 'project_id': '8e66b29e29094a429643e0308704753b', 'gw_port': {'id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:07:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_gateway', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:29Z', 'updated_at': '2021-05-31T16:21:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': 'ec5c850b-3c95-4ae6-869b-87be2055c0aa', 'name': '', 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'mac_address': 'fa:16:3e:cb:c9:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_interface', 'standard_attr_id': 328, 'fixed_ips': [{'subnet_id': '1a675b0f-478f-47e0-acdd-51bacffe39b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:36Z', 'updated_at': '2021-05-31T16:21:45Z', 'revision_number': 5, 'project_id': '8e66b29e29094a429643e0308704753b', 'subnets': [{'id': '1a675b0f-478f-47e0-acdd-51bacffe39b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:37.054953 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d571571-567f-413f-92e6-f1c3b1835050 None None] The sync data for ids ['7928d30e-0100-4eb5-9431-cf404997bd15'] in dv-cinder-793814-1-iscsi is: [{'id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'name': 'tempest-TestMinimumBasicScenario-134910460-router', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182'}], 'enable_snat': True}, 'gw_port_id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:27Z', 'updated_at': '2021-05-31T16:21:37Z', 'revision_number': 4, 'project_id': '8e66b29e29094a429643e0308704753b', 'gw_port': {'id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:07:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_gateway', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:29Z', 'updated_at': '2021-05-31T16:21:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': 'ec5c850b-3c95-4ae6-869b-87be2055c0aa', 'name': '', 'network_id': 'e3df5118-0a40-4a66-b31c-a978a0c899cf', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'mac_address': 'fa:16:3e:cb:c9:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_interface', 'standard_attr_id': 328, 'fixed_ips': [{'subnet_id': '1a675b0f-478f-47e0-acdd-51bacffe39b6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:36Z', 'updated_at': '2021-05-31T16:21:45Z', 'revision_number': 5, 'project_id': '8e66b29e29094a429643e0308704753b', 'subnets': [{'id': '1a675b0f-478f-47e0-acdd-51bacffe39b6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:25:37.164928 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e2f4edb1-9aa6-4125-81e7-6f2de19822cf req-23efa947-768e-4606-aecd-3f73dd229680 service neutron] 10.222.0.63 "GET /v2.0/networks/e3df5118-0a40-4a66-b31c-a978a0c899cf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2004621
May 31 16:25:37.351734 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea939f78-4165-4e2c-b02e-c7fa661ea7ad None None] New status for floating IP 0bdaa7f7-9a86-4bcf-a99d-ff3f1902bcc0: DOWN {{(pid=91766) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 31 16:25:37.730565 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d4a504d-1ba7-4aa9-9f86-f6352ed50ad7 req-b1197142-dc93-4a87-80ce-982f176bee19 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:37.732083 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7d4a504d-1ba7-4aa9-9f86-f6352ed50ad7 req-b1197142-dc93-4a87-80ce-982f176bee19 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 943 time: 0.0813446
May 31 16:25:37.786209 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7d4a504d-1ba7-4aa9-9f86-f6352ed50ad7 req-a0aa6913-cc9e-4652-98a2-1d6d42b7de70 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0468795
May 31 16:25:37.889001 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:38.212440 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-c3cf8015-090f-4031-9436-6fbced6e044e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:39.159278 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:40.866271 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:41.307516 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d454c4b-f04c-4c3a-a2f5-ece59da4f373 req-bd9de7e8-0573-4534-9211-e12f7ed6cc19 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:41.309764 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2d454c4b-f04c-4c3a-a2f5-ece59da4f373 req-bd9de7e8-0573-4534-9211-e12f7ed6cc19 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 943 time: 0.1026392
May 31 16:25:41.357654 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2d454c4b-f04c-4c3a-a2f5-ece59da4f373 req-2227edb0-f901-452e-b2b8-3a726a018b47 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0426130
May 31 16:25:42.558070 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d73ae477-75cf-4294-a941-9fb59f4d54d9 req-ffdf5b4e-db11-4a29-a0f2-bcad8c58cc2a tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:42.559468 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d73ae477-75cf-4294-a941-9fb59f4d54d9 req-ffdf5b4e-db11-4a29-a0f2-bcad8c58cc2a tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 943 time: 0.0900788
May 31 16:25:42.617184 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d73ae477-75cf-4294-a941-9fb59f4d54d9 req-908729e8-a7ec-4fa5-9eaa-082d3c539c0e tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0515413
May 31 16:25:43.809752 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6053f11-a59e-499d-93ea-4211742de43a req-3c421ba6-114e-441d-a7bd-93a821361d2d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:43.811349 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a6053f11-a59e-499d-93ea-4211742de43a req-3c421ba6-114e-441d-a7bd-93a821361d2d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 943 time: 0.0877793
May 31 16:25:43.846939 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 31d7a0be-14fe-4eee-8a37-db20d72be4ab details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:25:43.864232 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a6053f11-a59e-499d-93ea-4211742de43a req-7c7e8d0b-6e13-41cb-9984-22082851f125 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0466740
May 31 16:25:43.989866 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 31d7a0be-14fe-4eee-8a37-db20d72be4ab, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=31d7a0be-14fe-4eee-8a37-db20d72be4ab,segment=NetworkSegment(fb1fd409-498f-4f29-82bc-1d244a7a3ed1),segment_id=fb1fd409-498f-4f29-82bc-1d244a7a3ed1)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:25:44.004277 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': '31d7a0be-14fe-4eee-8a37-db20d72be4ab', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'port_id': '31d7a0be-14fe-4eee-8a37-db20d72be4ab', 'mac_address': 'fa:16:3e:a6:94:55', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 805, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:25:44.059861 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:44.065321 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa923ff2-e8c2-4760-b1be-06df79bb7d95 req-a479c290-3ef5-428d-ab1b-94b934145fe7 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:44.066064 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-aa923ff2-e8c2-4760-b1be-06df79bb7d95 req-a479c290-3ef5-428d-ab1b-94b934145fe7 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Synchronizing usage tracker for tenant:8e66b29e29094a429643e0308704753b on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:25:44.078131 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 31d7a0be-14fe-4eee-8a37-db20d72be4ab {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:25:44.085128 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-aa923ff2-e8c2-4760-b1be-06df79bb7d95 req-a479c290-3ef5-428d-ab1b-94b934145fe7 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Unset dirty status for tenant:8e66b29e29094a429643e0308704753b on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:25:44.087668 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-aa923ff2-e8c2-4760-b1be-06df79bb7d95 req-a479c290-3ef5-428d-ab1b-94b934145fe7 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 945 time: 0.1090274
May 31 16:25:44.098049 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 31d7a0be-14fe-4eee-8a37-db20d72be4ab, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=31d7a0be-14fe-4eee-8a37-db20d72be4ab,segment=NetworkSegment(fb1fd409-498f-4f29-82bc-1d244a7a3ed1),segment_id=fb1fd409-498f-4f29-82bc-1d244a7a3ed1)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:25:44.103730 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:44.106042 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:44.137429 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-aa923ff2-e8c2-4760-b1be-06df79bb7d95 req-63de5b6a-d7fb-42ce-9877-bf5cd0b32a08 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Synchronizing usage tracker for tenant:8e66b29e29094a429643e0308704753b on resource:security_group {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:25:44.156731 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-aa923ff2-e8c2-4760-b1be-06df79bb7d95 req-63de5b6a-d7fb-42ce-9877-bf5cd0b32a08 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Unset dirty status for tenant:8e66b29e29094a429643e0308704753b on resource:security_group {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:25:44.158554 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-aa923ff2-e8c2-4760-b1be-06df79bb7d95 req-63de5b6a-d7fb-42ce-9877-bf5cd0b32a08 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0622811
May 31 16:25:44.183189 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=31d7a0be-14fe-4eee-8a37-db20d72be4ab,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:44.186327 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:44.369606 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['31d7a0be-14fe-4eee-8a37-db20d72be4ab'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:25:45.088410 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5972c1ff-64ed-4b59-8855-3bd37e4309ed req-4efb865b-4a0f-43b4-a39a-9c14aed6f84b tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:45.088410 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5972c1ff-64ed-4b59-8855-3bd37e4309ed req-4efb865b-4a0f-43b4-a39a-9c14aed6f84b tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 944 time: 0.0877011
May 31 16:25:45.132100 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5972c1ff-64ed-4b59-8855-3bd37e4309ed req-caf8e6d5-ccf4-48d1-9f5a-f54d9e4b2554 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0398467
May 31 16:25:45.354268 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c50f0351-f0b8-405d-9c06-d38abad806d7 req-172d8cda-e04a-41df-a717-36683db7b437 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:45.355792 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c50f0351-f0b8-405d-9c06-d38abad806d7 req-172d8cda-e04a-41df-a717-36683db7b437 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 945 time: 0.0820031
May 31 16:25:45.404227 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c50f0351-f0b8-405d-9c06-d38abad806d7 req-d3ce4c31-a246-4f5d-8dea-3730f96b8fae tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425446
May 31 16:25:45.862120 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 31d7a0be-14fe-4eee-8a37-db20d72be4ab up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:25:45.932594 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning for port 31d7a0be-14fe-4eee-8a37-db20d72be4ab completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:25:45.937454 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port 31d7a0be-14fe-4eee-8a37-db20d72be4ab triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:25:45.937866 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:46.060389 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:46.089343 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '31d7a0be-14fe-4eee-8a37-db20d72be4ab'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:25:46.091600 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2aa3a10b-8194-4e34-b6b4-7003f770cd9c" -d '{"events": [{"server_uuid": "4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa", "name": "network-vif-plugged", "status": "completed", "tag": "31d7a0be-14fe-4eee-8a37-db20d72be4ab"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:25:46.099787 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 31d7a0be-14fe-4eee-8a37-db20d72be4ab, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=31d7a0be-14fe-4eee-8a37-db20d72be4ab,segment=NetworkSegment(fb1fd409-498f-4f29-82bc-1d244a7a3ed1),segment_id=fb1fd409-498f-4f29-82bc-1d244a7a3ed1)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:25:46.111099 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:46.112930 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:46.194449 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=31d7a0be-14fe-4eee-8a37-db20d72be4ab,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:46.206647 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:46.207004 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:46.207358 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:46.207982 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:46.208366 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:46.208705 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:46.209031 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:46.209359 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:46.209766 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:46.210035 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:46.210411 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:46.210738 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:25:46.215743 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:46.241377 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e121ed51-a4ea-4f2d-8996-bdc56b07e86b req-d7bb90d5-501e-454e-9d50-8c2f2e6db2a8 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:46.243608 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e121ed51-a4ea-4f2d-8996-bdc56b07e86b req-d7bb90d5-501e-454e-9d50-8c2f2e6db2a8 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.63 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 945 time: 0.1619165
May 31 16:25:46.281770 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:25:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-31204a63-8d93-4f78-91cf-05e0a9a6cb7e x-openstack-request-id: req-31204a63-8d93-4f78-91cf-05e0a9a6cb7e {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:25:46.282201 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa", "name": "network-vif-plugged", "status": "completed", "tag": "31d7a0be-14fe-4eee-8a37-db20d72be4ab", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:25:46.282595 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-31204a63-8d93-4f78-91cf-05e0a9a6cb7e {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:25:46.283057 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '31d7a0be-14fe-4eee-8a37-db20d72be4ab', 'code': 200}
May 31 16:25:46.455026 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [req-e121ed51-a4ea-4f2d-8996-bdc56b07e86b req-64776086-b6ac-4605-b651-a125c63c0437 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Deleting port 747cd83a-69bc-48d9-8ba9-e9638b7be825 {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:25:46.455376 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-e121ed51-a4ea-4f2d-8996-bdc56b07e86b req-64776086-b6ac-4605-b651-a125c63c0437 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:46.478378 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7d97a62-3406-431e-947a-5aab3aabdba5 req-eb78620d-d628-4106-a280-d516835347f5 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:46.479849 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e7d97a62-3406-431e-947a-5aab3aabdba5 req-eb78620d-d628-4106-a280-d516835347f5 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 945 time: 0.1684022
May 31 16:25:46.572460 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a7df3c0-d1cd-42d1-bdca-b7380155d04d req-a5469418-79ea-4851-a311-700bd0bad9ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:46.573979 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-3a7df3c0-d1cd-42d1-bdca-b7380155d04d req-a5469418-79ea-4851-a311-700bd0bad9ef service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 1098 time: 0.0708003
May 31 16:25:46.718185 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-3a7df3c0-d1cd-42d1-bdca-b7380155d04d req-6272de3b-05ef-41b0-a066-1ee80a75b524 service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1340251
May 31 16:25:46.759712 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e7d97a62-3406-431e-947a-5aab3aabdba5 req-c8852ca7-6a69-4e5c-948d-b9acf785e68d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2713437
May 31 16:25:46.797903 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-e121ed51-a4ea-4f2d-8996-bdc56b07e86b req-64776086-b6ac-4605-b651-a125c63c0437 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] For port 747cd83a-69bc-48d9-8ba9-e9638b7be825, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=747cd83a-69bc-48d9-8ba9-e9638b7be825,segment=NetworkSegment(44700c9f-b523-4212-86eb-cc7308ee0431),segment_id=44700c9f-b523-4212-86eb-cc7308ee0431)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:25:46.798324 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-e121ed51-a4ea-4f2d-8996-bdc56b07e86b req-64776086-b6ac-4605-b651-a125c63c0437 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:46.941487 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [req-e121ed51-a4ea-4f2d-8996-bdc56b07e86b req-64776086-b6ac-4605-b651-a125c63c0437 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Calling delete_port for 747cd83a-69bc-48d9-8ba9-e9638b7be825 owned by compute:nova {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:25:46.961843 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffb68884-4451-4008-8363-e7e5e90ee548 req-aa283981-ff07-47bc-aac9-46d82c814a42 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:46.963235 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ffb68884-4451-4008-8363-e7e5e90ee548 req-aa283981-ff07-47bc-aac9-46d82c814a42 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/ports?device_id=1d2436ad-b7ce-4d4c-851a-544a84fe2ef5 HTTP/1.1" status: 200  len: 945 time: 0.4075069
May 31 16:25:47.033746 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ffb68884-4451-4008-8363-e7e5e90ee548 req-bc24fd74-c701-4eb9-a862-ba413bfb8a09 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.43 "GET /v2.0/security-groups?id=36428dc9-0862-4d53-8a33-6b298f5353c7&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0542774
May 31 16:25:47.122090 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-e121ed51-a4ea-4f2d-8996-bdc56b07e86b req-64776086-b6ac-4605-b651-a125c63c0437 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:47.128538 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-9b77df23-3d86-4fc5-b891-41fd0a9f54f5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:47.152241 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['747cd83a-69bc-48d9-8ba9-e9638b7be825'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:25:47.179052 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64776086-b6ac-4605-b651-a125c63c0437 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Pushing event deleted for resources: {'Port': ['ID=747cd83a-69bc-48d9-8ba9-e9638b7be825,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:47.182170 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-64776086-b6ac-4605-b651-a125c63c0437 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:47.253088 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [req-e121ed51-a4ea-4f2d-8996-bdc56b07e86b req-64776086-b6ac-4605-b651-a125c63c0437 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] No DVR routers for this DVR port 747cd83a-69bc-48d9-8ba9-e9638b7be825 on host hv-cinder-79381 {{(pid=91764) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:25:47.255468 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-e121ed51-a4ea-4f2d-8996-bdc56b07e86b req-64776086-b6ac-4605-b651-a125c63c0437 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:47.258083 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1d2436ad-b7ce-4d4c-851a-544a84fe2ef5', 'name': 'network-vif-deleted', 'tag': '747cd83a-69bc-48d9-8ba9-e9638b7be825'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:25:47.260322 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6d419924-4ce1-43f1-a1ec-1610d9a1d441" -d '{"events": [{"server_uuid": "1d2436ad-b7ce-4d4c-851a-544a84fe2ef5", "name": "network-vif-deleted", "tag": "747cd83a-69bc-48d9-8ba9-e9638b7be825"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:25:47.275578 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e121ed51-a4ea-4f2d-8996-bdc56b07e86b req-64776086-b6ac-4605-b651-a125c63c0437 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] 10.222.0.63 "DELETE /v2.0/ports/747cd83a-69bc-48d9-8ba9-e9638b7be825 HTTP/1.1" status: 204  len: 173 time: 1.0250051
May 31 16:25:47.306259 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:25:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-25e07eb5-e2d3-4301-a986-47b28dca055d x-openstack-request-id: req-25e07eb5-e2d3-4301-a986-47b28dca055d {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:25:47.306598 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1d2436ad-b7ce-4d4c-851a-544a84fe2ef5", "name": "network-vif-deleted", "tag": "747cd83a-69bc-48d9-8ba9-e9638b7be825", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:25:47.306886 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-25e07eb5-e2d3-4301-a986-47b28dca055d {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:25:47.307363 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1d2436ad-b7ce-4d4c-851a-544a84fe2ef5', 'name': 'network-vif-deleted', 'tag': '747cd83a-69bc-48d9-8ba9-e9638b7be825', 'status': 'completed', 'code': 200}
May 31 16:25:47.974988 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e6a53e-f14e-427b-88e1-57f483ec8cf0 req-72ef123a-dd33-4774-baec-ad5bb51a92dc tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:47.976544 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-56e6a53e-f14e-427b-88e1-57f483ec8cf0 req-72ef123a-dd33-4774-baec-ad5bb51a92dc tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 945 time: 0.1017196
May 31 16:25:48.041607 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-56e6a53e-f14e-427b-88e1-57f483ec8cf0 req-08377536-f7e5-4917-be9e-0cc200d0f80d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0567572
May 31 16:25:48.267489 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54eead30-4e91-4d33-a0de-251a03f39a39 req-f8a1d9e6-b4bf-48cf-a3a2-61cf33b1e76b tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:48.269265 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-54eead30-4e91-4d33-a0de-251a03f39a39 req-f8a1d9e6-b4bf-48cf-a3a2-61cf33b1e76b tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 945 time: 0.0963700
May 31 16:25:48.317488 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-54eead30-4e91-4d33-a0de-251a03f39a39 req-5cc035d7-abbf-4e2a-bc8d-a478777e68ff tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0419362
May 31 16:25:48.350615 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36152) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:48.431392 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a4871a48-47a6-4c3f-bc0f-d9f3184d0dda tempest-TestVolumeBootPattern-2042821890 tempest-TestVolumeBootPattern-2042821890-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:48.433569 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-a4871a48-47a6-4c3f-bc0f-d9f3184d0dda tempest-TestVolumeBootPattern-2042821890 tempest-TestVolumeBootPattern-2042821890-project-admin] 10.222.0.43 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 1093 time: 0.0812182
May 31 16:25:48.436167 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 36168) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:48.444406 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Request body: {'floatingip': {'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'port_id': '31d7a0be-14fe-4eee-8a37-db20d72be4ab', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'fixed_ip_address': '172.20.0.4'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:25:48.450496 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:25:48.456724 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Usage tracker for resource:floatingip and tenant:092115f69b8e401b8c334f7b3e797aad is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:25:48.460126 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:25:48.467106 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:25:48.490089 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for floatingip, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:48.646237 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:48.812155 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Allocated IP 172.27.0.15 (00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c/96709d85-d0fe-4cf8-b232-eaf6b143ebe6/a36be541-ee07-4d66-bbb9-9c950584b8d0) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:25:48.976972 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36200) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:48.978353 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:49.011119 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:49.017636 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:49.082061 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:25:49.085846 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:25:49.088483 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:25:49.211033 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Pushing event updated for resources: {'Port': ['ID=a36be541-ee07-4d66-bbb9-9c950584b8d0,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:49.214611 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.197s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:49.657386 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3721f8aa-4024-42ad-ad57-f3c1da8868eb req-151db13d-5195-4946-aea9-a9f77081b725 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:49.659474 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3721f8aa-4024-42ad-ad57-f3c1da8868eb req-151db13d-5195-4946-aea9-a9f77081b725 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.2215350
May 31 16:25:49.671700 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:49.683940 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:49.741851 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3721f8aa-4024-42ad-ad57-f3c1da8868eb req-84c331a9-574a-471f-9973-2ee296c1644c tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0695322
May 31 16:25:49.780188 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:49.855043 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-55daac37-51dc-4837-8100-9ec2def05dc6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-16627919'] for router_interface, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:49.872115 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 747cd83a-69bc-48d9-8ba9-e9638b7be825 no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:25:49.910649 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] No Port match for: 747cd83a-69bc-48d9-8ba9-e9638b7be825 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:25:49.911023 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 747cd83a-69bc-48d9-8ba9-e9638b7be825 not bound to the agent host hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:25:50.011876 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for port, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:50.021574 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14337082'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:50.025896 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:50.134812 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Pushing event updated for resources: {'Port': ['ID=a36be541-ee07-4d66-bbb9-9c950584b8d0,revision_number=2']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:50.139023 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:50.153898 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16621821'] for floatingip, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:50.423403 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.l3_db [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Floating IP 4cfa0151-ec70-4a38-950b-45cdd617fd1a associated. External IP: 172.27.0.15, port: 31d7a0be-14fe-4eee-8a37-db20d72be4ab.
May 31 16:25:50.506324 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-55daac37-51dc-4837-8100-9ec2def05dc6 admin admin] Deleting port ec5c850b-3c95-4ae6-869b-87be2055c0aa {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:25:50.506659 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-55daac37-51dc-4837-8100-9ec2def05dc6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:50.640444 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [None req-55daac37-51dc-4837-8100-9ec2def05dc6 admin admin] For port ec5c850b-3c95-4ae6-869b-87be2055c0aa, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=ec5c850b-3c95-4ae6-869b-87be2055c0aa,segment=NetworkSegment(44700c9f-b523-4212-86eb-cc7308ee0431),segment_id=44700c9f-b523-4212-86eb-cc7308ee0431)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:25:50.640840 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-55daac37-51dc-4837-8100-9ec2def05dc6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:50.795420 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-55daac37-51dc-4837-8100-9ec2def05dc6 admin admin] Calling delete_port for ec5c850b-3c95-4ae6-869b-87be2055c0aa owned by network:router_interface {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:25:51.027726 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Router 80126872-1960-4f13-9ca2-0eaf66181e32 has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91763) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:25:51.153001 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b2d8051-17b1-437c-a2be-9045d65d101e req-9371192d-e453-4b9a-9dbf-287558d4c7e2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:51.161714 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1b2d8051-17b1-437c-a2be-9045d65d101e req-9371192d-e453-4b9a-9dbf-287558d4c7e2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.1804492
May 31 16:25:51.255140 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1b2d8051-17b1-437c-a2be-9045d65d101e req-7f8336d8-bdf6-432d-af15-14f83034d573 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0924489
May 31 16:25:51.276554 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-55daac37-51dc-4837-8100-9ec2def05dc6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:51.281412 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:25:51.281923 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:51.298471 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7413aed-d354-42d1-92db-86f457f6e75e None None] Sync routers for ids ['80126872-1960-4f13-9ca2-0eaf66181e32'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:25:51.310044 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7413aed-d354-42d1-92db-86f457f6e75e None None] Routers {'80126872-1960-4f13-9ca2-0eaf66181e32'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:25:51.310804 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-d7413aed-d354-42d1-92db-86f457f6e75e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f14266c2220>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:25:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['80126872-1960-4f13-9ca2-0eaf66181e32'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:51.316642 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for floatingip, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:51.334388 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55daac37-51dc-4837-8100-9ec2def05dc6 admin admin] Pushing event deleted for resources: {'Port': ['ID=ec5c850b-3c95-4ae6-869b-87be2055c0aa,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:51.337618 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-55daac37-51dc-4837-8100-9ec2def05dc6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:51.398789 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 995 time: 2.9602675
May 31 16:25:51.399540 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa', 'tag': '31d7a0be-14fe-4eee-8a37-db20d72be4ab'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:25:51.402216 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-69154e96-6e66-4dfc-bcc3-37ed431bc35d" -d '{"events": [{"name": "network-changed", "server_uuid": "4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa", "tag": "31d7a0be-14fe-4eee-8a37-db20d72be4ab"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:25:51.459644 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:25:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-94ac45ed-8746-4898-9b82-f0912b595ee1 x-openstack-request-id: req-94ac45ed-8746-4898-9b82-f0912b595ee1 {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:25:51.459975 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa", "tag": "31d7a0be-14fe-4eee-8a37-db20d72be4ab", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:25:51.460370 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-94ac45ed-8746-4898-9b82-f0912b595ee1 {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:25:51.460805 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa', 'tag': '31d7a0be-14fe-4eee-8a37-db20d72be4ab', 'status': 'completed', 'code': 200}
May 31 16:25:51.559029 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-d7413aed-d354-42d1-92db-86f457f6e75e None None] Set router 80126872-1960-4f13-9ca2-0eaf66181e32 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:25:51.733650 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-55daac37-51dc-4837-8100-9ec2def05dc6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-16317375', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-16625247'] for router_interface, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:51.740080 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69154e96-6e66-4dfc-bcc3-37ed431bc35d req-4c73098f-f279-4bec-8931-bf9b10ab347c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:51.741658 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-69154e96-6e66-4dfc-bcc3-37ed431bc35d req-4c73098f-f279-4bec-8931-bf9b10ab347c service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=092115f69b8e401b8c334f7b3e797aad&device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 1098 time: 0.2554772
May 31 16:25:51.965538 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-d7413aed-d354-42d1-92db-86f457f6e75e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f14266c2220>, [{'id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229'}], 'enable_snat': True}, 'gw_port_id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:05Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 4, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'gw_port': {'id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:b8:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:06Z', 'updated_at': '2021-05-31T16:21:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': '4cfa0151-ec70-4a38-950b-45cdd617fd1a', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'floating_ip_address': '172.27.0.15', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'port_id': '31d7a0be-14fe-4eee-8a37-db20d72be4ab', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 534, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'mac_address': 'fa:16:3e:a6:94:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:25:49Z', 'updated_at': '2021-05-31T16:25:49Z', 'revision_number': 0, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '27a83f61-e253-4ba1-954c-e810e9a33917', 'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'mac_address': 'fa:16:3e:fc:8a:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_interface', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:09Z', 'updated_at': '2021-05-31T16:21:20Z', 'revision_number': 5, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'subnets': [{'id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:51.969678 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7413aed-d354-42d1-92db-86f457f6e75e None None] Checking router: 80126872-1960-4f13-9ca2-0eaf66181e32 for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:25:51.978532 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7413aed-d354-42d1-92db-86f457f6e75e None None] Routers {'80126872-1960-4f13-9ca2-0eaf66181e32'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:25:51.979157 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-d7413aed-d354-42d1-92db-86f457f6e75e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f14266c2220>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:25:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['80126872-1960-4f13-9ca2-0eaf66181e32'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:52.149640 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69154e96-6e66-4dfc-bcc3-37ed431bc35d req-6793a0fc-9365-4c37-925e-00d9c16e6ab1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:52.151061 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-69154e96-6e66-4dfc-bcc3-37ed431bc35d req-6793a0fc-9365-4c37-925e-00d9c16e6ab1 service neutron] 10.222.0.63 "GET /v2.0/networks?id=5b237728-dc31-4203-bbac-66ce3db1593a HTTP/1.1" status: 200  len: 913 time: 0.2455781
May 31 16:25:52.171642 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-d7413aed-d354-42d1-92db-86f457f6e75e None None] Set router 80126872-1960-4f13-9ca2-0eaf66181e32 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:25:52.482700 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-69154e96-6e66-4dfc-bcc3-37ed431bc35d req-e907edf3-b333-4b6a-81be-b0db5b028f1e service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=31d7a0be-14fe-4eee-8a37-db20d72be4ab HTTP/1.1" status: 200  len: 998 time: 0.2708647
May 31 16:25:52.659585 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-55daac37-51dc-4837-8100-9ec2def05dc6 admin admin] Router 7928d30e-0100-4eb5-9431-cf404997bd15 has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91764) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:25:52.683882 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-d7413aed-d354-42d1-92db-86f457f6e75e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f14266c2220>, [{'id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229'}], 'enable_snat': True}, 'gw_port_id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:05Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 4, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'gw_port': {'id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:b8:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:06Z', 'updated_at': '2021-05-31T16:21:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': '4cfa0151-ec70-4a38-950b-45cdd617fd1a', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'floating_ip_address': '172.27.0.15', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'port_id': '31d7a0be-14fe-4eee-8a37-db20d72be4ab', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 534, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'mac_address': 'fa:16:3e:a6:94:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:25:49Z', 'updated_at': '2021-05-31T16:25:49Z', 'revision_number': 0, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '27a83f61-e253-4ba1-954c-e810e9a33917', 'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'mac_address': 'fa:16:3e:fc:8a:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_interface', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:09Z', 'updated_at': '2021-05-31T16:21:20Z', 'revision_number': 5, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'subnets': [{'id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:52.689315 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69154e96-6e66-4dfc-bcc3-37ed431bc35d req-a3691743-c1a5-4191-8a0c-6a1acb1f13ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:52.690435 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7413aed-d354-42d1-92db-86f457f6e75e None None] The sync data for ids ['80126872-1960-4f13-9ca2-0eaf66181e32'] in dv-cinder-793814-1-iscsi is: [{'id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229'}], 'enable_snat': True}, 'gw_port_id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:05Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 4, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'gw_port': {'id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:b8:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:06Z', 'updated_at': '2021-05-31T16:21:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': '4cfa0151-ec70-4a38-950b-45cdd617fd1a', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'floating_ip_address': '172.27.0.15', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'port_id': '31d7a0be-14fe-4eee-8a37-db20d72be4ab', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 534, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'mac_address': 'fa:16:3e:a6:94:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:25:49Z', 'updated_at': '2021-05-31T16:25:49Z', 'revision_number': 0, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '27a83f61-e253-4ba1-954c-e810e9a33917', 'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'mac_address': 'fa:16:3e:fc:8a:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_interface', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:09Z', 'updated_at': '2021-05-31T16:21:20Z', 'revision_number': 5, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'subnets': [{'id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:25:52.692871 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-69154e96-6e66-4dfc-bcc3-37ed431bc35d req-a3691743-c1a5-4191-8a0c-6a1acb1f13ae service neutron] 10.222.0.63 "GET /v2.0/subnets?id=995d9a2e-7e88-458e-9385-d135c0e07276 HTTP/1.1" status: 200  len: 851 time: 0.1704104
May 31 16:25:52.941490 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-270af0d2-53ed-4222-8720-3eac6d45678e req-cdf69aa4-6b84-4dc0-80fb-ef2c455d41f3 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:52.949199 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-270af0d2-53ed-4222-8720-3eac6d45678e req-cdf69aa4-6b84-4dc0-80fb-ef2c455d41f3 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.4735813
May 31 16:25:53.025932 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f16e0b53-7a02-4624-a9ab-5c109c587d37 None None] New status for floating IP 4cfa0151-ec70-4a38-950b-45cdd617fd1a: ACTIVE {{(pid=91766) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 31 16:25:53.109985 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-55daac37-51dc-4837-8100-9ec2def05dc6 admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91764) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:25:53.122862 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e68279af-ef2c-4a2d-a017-f559f7a93aa8 None None] Sync routers for ids ['7928d30e-0100-4eb5-9431-cf404997bd15'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:25:53.147611 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e68279af-ef2c-4a2d-a017-f559f7a93aa8 None None] Routers {'7928d30e-0100-4eb5-9431-cf404997bd15'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:25:53.150291 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-e68279af-ef2c-4a2d-a017-f559f7a93aa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f14267a2be0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:25:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['7928d30e-0100-4eb5-9431-cf404997bd15'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:53.164692 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-55daac37-51dc-4837-8100-9ec2def05dc6 admin admin] 10.222.0.43 "PUT /v2.0/routers/7928d30e-0100-4eb5-9431-cf404997bd15/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 4.1862922
May 31 16:25:53.167378 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 36274) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:53.178094 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-270af0d2-53ed-4222-8720-3eac6d45678e req-bc813ea2-eed0-42cd-8cc2-901c8fc41412 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2279077
May 31 16:25:53.204827 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69154e96-6e66-4dfc-bcc3-37ed431bc35d req-efbf67dd-8cc0-4fef-b3bb-4436d23014bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:53.207691 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-69154e96-6e66-4dfc-bcc3-37ed431bc35d req-efbf67dd-8cc0-4fef-b3bb-4436d23014bf service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=5b237728-dc31-4203-bbac-66ce3db1593a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.5030165
May 31 16:25:53.418124 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-e68279af-ef2c-4a2d-a017-f559f7a93aa8 None None] Set router 7928d30e-0100-4eb5-9431-cf404997bd15 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:25:53.451496 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-69154e96-6e66-4dfc-bcc3-37ed431bc35d req-61ddb881-3bb0-4b8e-a96a-21c0ffd3f7b2 service neutron] 10.222.0.63 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2355120
May 31 16:25:53.454768 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6961478e-4882-41c9-b6f1-7db11bfadfe2 admin admin] Notify callbacks [] for router, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:53.625728 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-69154e96-6e66-4dfc-bcc3-37ed431bc35d req-f3981a06-419f-49a8-86c6-d9d97632c4c3 service neutron] 10.222.0.63 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1652615
May 31 16:25:53.666229 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6961478e-4882-41c9-b6f1-7db11bfadfe2 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:53.744850 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-e68279af-ef2c-4a2d-a017-f559f7a93aa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f14267a2be0>, [{'id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'name': 'tempest-TestMinimumBasicScenario-134910460-router', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182'}], 'enable_snat': True}, 'gw_port_id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:27Z', 'updated_at': '2021-05-31T16:25:51Z', 'revision_number': 5, 'project_id': '8e66b29e29094a429643e0308704753b', 'gw_port': {'id': 'a225a2ee-fc85-4ac1-9115-01b63bb0296a', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:62:07:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'device_owner': 'network:router_gateway', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.182', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:29Z', 'updated_at': '2021-05-31T16:21:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:53.748271 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-6961478e-4882-41c9-b6f1-7db11bfadfe2 admin admin] Deleting port a225a2ee-fc85-4ac1-9115-01b63bb0296a {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:25:53.748590 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6961478e-4882-41c9-b6f1-7db11bfadfe2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:53.749309 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e68279af-ef2c-4a2d-a017-f559f7a93aa8 None None] Checking router: 7928d30e-0100-4eb5-9431-cf404997bd15 for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:25:53.759396 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e68279af-ef2c-4a2d-a017-f559f7a93aa8 None None] Routers {'7928d30e-0100-4eb5-9431-cf404997bd15'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:25:53.760017 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-e68279af-ef2c-4a2d-a017-f559f7a93aa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f14267a2be0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:25:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['7928d30e-0100-4eb5-9431-cf404997bd15'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:53.888826 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [None req-6961478e-4882-41c9-b6f1-7db11bfadfe2 admin admin] For port a225a2ee-fc85-4ac1-9115-01b63bb0296a, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=a225a2ee-fc85-4ac1-9115-01b63bb0296a,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:25:53.889367 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6961478e-4882-41c9-b6f1-7db11bfadfe2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:53.926022 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36282) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:53.944439 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-e68279af-ef2c-4a2d-a017-f559f7a93aa8 None None] Set router 7928d30e-0100-4eb5-9431-cf404997bd15 gateway port host: None {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:25:54.126161 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_v2 [None req-bd17eeb4-fec1-4319-9c5f-e97e41ed51d1 admin admin] Deleting subnet e9f7875f-b5af-4ade-af35-3604ed5d2f89 {{(pid=91764) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 31 16:25:54.129444 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bd17eeb4-fec1-4319-9c5f-e97e41ed51d1 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:54.137759 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-e68279af-ef2c-4a2d-a017-f559f7a93aa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f14267a2be0>, [{'id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'name': 'tempest-TestMinimumBasicScenario-134910460-router', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:27Z', 'updated_at': '2021-05-31T16:25:53Z', 'revision_number': 6, 'project_id': '8e66b29e29094a429643e0308704753b', 'gw_port_host': None}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:54.142733 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e68279af-ef2c-4a2d-a017-f559f7a93aa8 None None] The sync data for ids ['7928d30e-0100-4eb5-9431-cf404997bd15'] in dv-cinder-793814-1-iscsi is: [{'id': '7928d30e-0100-4eb5-9431-cf404997bd15', 'name': 'tempest-TestMinimumBasicScenario-134910460-router', 'tenant_id': '8e66b29e29094a429643e0308704753b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:27Z', 'updated_at': '2021-05-31T16:25:53Z', 'revision_number': 6, 'project_id': '8e66b29e29094a429643e0308704753b', 'gw_port_host': None}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:25:54.186657 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-6961478e-4882-41c9-b6f1-7db11bfadfe2 admin admin] Calling delete_port for a225a2ee-fc85-4ac1-9115-01b63bb0296a owned by network:router_gateway {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:25:54.194079 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bd17eeb4-fec1-4319-9c5f-e97e41ed51d1 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14907384'] for subnet, precommit_delete_associations {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:54.262202 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bd17eeb4-fec1-4319-9c5f-e97e41ed51d1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-975336'] for subnet, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:54.480437 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6961478e-4882-41c9-b6f1-7db11bfadfe2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:54.485719 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-6330a3b6-a9db-46b4-89d2-d26c3eb03909 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:54.496412 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85f5f127-1be3-4d85-86b8-0d5046e2d749 req-4e154ed5-0060-4b3b-aac7-f3c15278c051 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:54.504138 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-85f5f127-1be3-4d85-86b8-0d5046e2d749 req-4e154ed5-0060-4b3b-aac7-f3c15278c051 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.2009892
May 31 16:25:54.524881 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device ec5c850b-3c95-4ae6-869b-87be2055c0aa no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:25:54.541562 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6961478e-4882-41c9-b6f1-7db11bfadfe2 admin admin] Pushing event deleted for resources: {'Port': ['ID=a225a2ee-fc85-4ac1-9115-01b63bb0296a,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:54.544908 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-6961478e-4882-41c9-b6f1-7db11bfadfe2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:54.578771 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: ec5c850b-3c95-4ae6-869b-87be2055c0aa {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:25:54.579351 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device ec5c850b-3c95-4ae6-869b-87be2055c0aa not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:25:54.636074 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-85f5f127-1be3-4d85-86b8-0d5046e2d749 req-ed6daeb4-8da1-4772-b319-f9a23367a211 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1309073
May 31 16:25:54.672400 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6961478e-4882-41c9-b6f1-7db11bfadfe2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-16621778'] for router_gateway, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:54.677238 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bd17eeb4-fec1-4319-9c5f-e97e41ed51d1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-978269', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14907170', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14793691'] for subnet, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:54.682272 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:54.717851 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd17eeb4-fec1-4319-9c5f-e97e41ed51d1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e9f7875f-b5af-4ade-af35-3604ed5d2f89,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:54.719809 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bd17eeb4-fec1-4319-9c5f-e97e41ed51d1 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:54.722719 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-bd17eeb4-fec1-4319-9c5f-e97e41ed51d1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:54.727203 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-bd17eeb4-fec1-4319-9c5f-e97e41ed51d1 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/e9f7875f-b5af-4ade-af35-3604ed5d2f89 HTTP/1.1" status: 204  len: 168 time: 0.8001444
May 31 16:25:54.729951 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36292) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:54.854127 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-90e0baa6-dca9-41de-b287-921b51baba2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-525980'] for network, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:54.854696 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6961478e-4882-41c9-b6f1-7db11bfadfe2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-16623711', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-683'] for router, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:54.856986 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6961478e-4882-41c9-b6f1-7db11bfadfe2 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:54.882267 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6961478e-4882-41c9-b6f1-7db11bfadfe2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-16623971'] for router, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:54.882774 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6961478e-4882-41c9-b6f1-7db11bfadfe2 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7928d30e-0100-4eb5-9431-cf404997bd15 {{(pid=91763) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 31 16:25:54.896768 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6961478e-4882-41c9-b6f1-7db11bfadfe2 admin admin] Notify callbacks [] for router, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:54.897937 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-6961478e-4882-41c9-b6f1-7db11bfadfe2 admin admin] 10.222.0.43 "DELETE /v2.0/routers/7928d30e-0100-4eb5-9431-cf404997bd15 HTTP/1.1" status: 204  len: 168 time: 1.7291791
May 31 16:25:54.900472 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 36298) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:54.961622 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_v2 [None req-ffdc103d-8d04-4b7f-934b-1a6ac1f17714 admin admin] Deleting subnet 1a675b0f-478f-47e0-acdd-51bacffe39b6 {{(pid=91763) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 31 16:25:54.964662 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ffdc103d-8d04-4b7f-934b-1a6ac1f17714 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:54.983561 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-90e0baa6-dca9-41de-b287-921b51baba2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-988775', 'neutron.services.segments.db._delete_segments_for_network-8732784586204'] for network, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:54.998001 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-90e0baa6-dca9-41de-b287-921b51baba2a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f142540b610>,) {'filters': {'network_id': ['52011424-acd2-4b1b-9a3c-ebda39ad09da']}} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:55.012088 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-90e0baa6-dca9-41de-b287-921b51baba2a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f142540b610>, '54d58804-a1bf-4e3a-8d44-cdd8f5cc124a') {'for_net_delete': True} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:55.012981 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-90e0baa6-dca9-41de-b287-921b51baba2a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f142540b610>, '54d58804-a1bf-4e3a-8d44-cdd8f5cc124a') {} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:55.026479 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-90e0baa6-dca9-41de-b287-921b51baba2a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732784599197', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14907379'] for segment, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:55.031403 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ffdc103d-8d04-4b7f-934b-1a6ac1f17714 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-15104879'] for subnet, precommit_delete_associations {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:55.053134 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-90e0baa6-dca9-41de-b287-921b51baba2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:55.061256 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-90e0baa6-dca9-41de-b287-921b51baba2a admin admin] Releasing vlan 820 on physical network physnet1 to pool {{(pid=91764) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 31 16:25:55.061862 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-90e0baa6-dca9-41de-b287-921b51baba2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14905732'] for segment, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]: Traceback (most recent call last):
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:     timer()
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:     cb(*args, **kw)
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:     return func(*args, **kwargs)
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:     self._notify()
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:     self.callback(batched_events)
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:     event.method(event)
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:     aggregate_uuid = self.p_client.list_aggregates(
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:     return f(self, *a, **k)
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self._get(url).json()
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self.request(url, 'GET', **kwargs)
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:     base_url = self.get_endpoint(auth, allow=allow,
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 31 16:25:55.075988 dv-cinder-793814-1-iscsi neutron-server[91764]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 31 16:25:55.164809 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-90e0baa6-dca9-41de-b287-921b51baba2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16621775'] for network, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:55.169755 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-90e0baa6-dca9-41de-b287-921b51baba2a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:55.173336 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:55.177643 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ffdc103d-8d04-4b7f-934b-1a6ac1f17714 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-975336'] for subnet, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:55.199474 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90e0baa6-dca9-41de-b287-921b51baba2a admin admin] Pushing event deleted for resources: {'Network': ['ID=52011424-acd2-4b1b-9a3c-ebda39ad09da,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:55.202288 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-90e0baa6-dca9-41de-b287-921b51baba2a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:55.204879 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-90e0baa6-dca9-41de-b287-921b51baba2a admin admin] 10.222.0.43 "DELETE /v2.0/networks/52011424-acd2-4b1b-9a3c-ebda39ad09da HTTP/1.1" status: 204  len: 168 time: 0.4733324
May 31 16:25:55.409362 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36306) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:55.447384 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ffdc103d-8d04-4b7f-934b-1a6ac1f17714 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-978269', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14336704', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-13992643'] for subnet, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:55.453542 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:55.464118 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-ca4ad2ab-be6d-41e8-b038-87d9c8f501ca admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=8f633dd4e3b241db904e4505f98ebe62&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0533140
May 31 16:25:55.466486 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36310) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:55.492061 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffdc103d-8d04-4b7f-934b-1a6ac1f17714 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1a675b0f-478f-47e0-acdd-51bacffe39b6,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:55.495067 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-ffdc103d-8d04-4b7f-934b-1a6ac1f17714 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:55.496064 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ffdc103d-8d04-4b7f-934b-1a6ac1f17714 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:55.503418 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-ffdc103d-8d04-4b7f-934b-1a6ac1f17714 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/1a675b0f-478f-47e0-acdd-51bacffe39b6 HTTP/1.1" status: 204  len: 168 time: 0.6017380
May 31 16:25:55.506277 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab0f358d-d629-4b82-9c39-fbb0453c5164 None None] Network e3df5118-0a40-4a66-b31c-a978a0c899cf requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:25:55.506790 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 36314) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:55.539968 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-04e480de-8cce-4eeb-bc0c-a9ac81fda1c8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:55.571227 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-04e480de-8cce-4eeb-bc0c-a9ac81fda1c8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:55.625166 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-525980'] for network, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:55.629951 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-04e480de-8cce-4eeb-bc0c-a9ac81fda1c8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:55.635626 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-45815ddc-3ba0-4941-8cf2-917c101a892a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:55.648804 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04e480de-8cce-4eeb-bc0c-a9ac81fda1c8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b7938be0-8a2c-4f7f-97e1-241934e0bfb0,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:55.651878 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-04e480de-8cce-4eeb-bc0c-a9ac81fda1c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:55.655095 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-04e480de-8cce-4eeb-bc0c-a9ac81fda1c8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:55.655500 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-04e480de-8cce-4eeb-bc0c-a9ac81fda1c8 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/b7938be0-8a2c-4f7f-97e1-241934e0bfb0 HTTP/1.1" status: 204  len: 168 time: 0.1879838
May 31 16:25:55.707682 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] Deleting port fce86ab6-1557-4a78-936b-fe27e15e00ac {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:25:55.708196 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:55.832355 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-092e63fe-23a8-42ec-86aa-3d7d318e2477 None None] DHCP port deletion for e3df5118-0a40-4a66-b31c-a978a0c899cf request from dv-cinder-793814-1-iscsi {{(pid=91765) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 31 16:25:55.884148 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d77f43e2-42f9-47ba-986c-ca6358fffaa1 req-5592106a-5a9a-40b4-a39e-b12191670e2f tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:55.891835 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d77f43e2-42f9-47ba-986c-ca6358fffaa1 req-5592106a-5a9a-40b4-a39e-b12191670e2f tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.1202645
May 31 16:25:55.914248 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-092e63fe-23a8-42ec-86aa-3d7d318e2477 None None] Deleting port fce86ab6-1557-4a78-936b-fe27e15e00ac {{(pid=91765) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:25:55.915087 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-092e63fe-23a8-42ec-86aa-3d7d318e2477 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:55.939486 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d77f43e2-42f9-47ba-986c-ca6358fffaa1 req-baae5e0c-2797-45da-aa38-a5110db7e577 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0467300
May 31 16:25:55.945190 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] For port fce86ab6-1557-4a78-936b-fe27e15e00ac, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=fce86ab6-1557-4a78-936b-fe27e15e00ac,segment=NetworkSegment(44700c9f-b523-4212-86eb-cc7308ee0431),segment_id=44700c9f-b523-4212-86eb-cc7308ee0431)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:25:55.945869 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:56.057012 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-092e63fe-23a8-42ec-86aa-3d7d318e2477 None None] For port fce86ab6-1557-4a78-936b-fe27e15e00ac, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=fce86ab6-1557-4a78-936b-fe27e15e00ac,segment=NetworkSegment(44700c9f-b523-4212-86eb-cc7308ee0431),segment_id=44700c9f-b523-4212-86eb-cc7308ee0431)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:25:56.057442 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-092e63fe-23a8-42ec-86aa-3d7d318e2477 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:56.087300 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] Calling delete_port for fce86ab6-1557-4a78-936b-fe27e15e00ac owned by network:dhcp {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:25:56.137944 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:56.141858 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-4ea9ca4c-62c0-46e7-aeb0-cc11b7c2249e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:56.187275 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-092e63fe-23a8-42ec-86aa-3d7d318e2477 None None] Calling delete_port for fce86ab6-1557-4a78-936b-fe27e15e00ac owned by network:dhcp {{(pid=91765) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:25:56.188473 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] Pushing event deleted for resources: {'Port': ['ID=fce86ab6-1557-4a78-936b-fe27e15e00ac,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:56.192283 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:56.193076 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] No DVR routers for this DVR port fce86ab6-1557-4a78-936b-fe27e15e00ac on host dv-cinder-793814-1-iscsi {{(pid=91763) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:25:56.308720 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-988775', 'neutron.services.segments.db._delete_segments_for_network-8732784586204'] for network, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:56.319645 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-092e63fe-23a8-42ec-86aa-3d7d318e2477 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907'] for port, after_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:56.323543 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f1426141a60>,) {'filters': {'network_id': ['e3df5118-0a40-4a66-b31c-a978a0c899cf']}} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:56.325780 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:56.335866 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f1426141a60>, '44700c9f-b523-4212-86eb-cc7308ee0431') {'for_net_delete': True} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:56.336160 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f1426141a60>, '44700c9f-b523-4212-86eb-cc7308ee0431') {} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:56.347405 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732784599197', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15104868'] for segment, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:56.353607 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device fce86ab6-1557-4a78-936b-fe27e15e00ac no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:25:56.364100 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:56.370238 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] Releasing vlan 808 on physical network physnet1 to pool {{(pid=91763) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 31 16:25:56.370621 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14337126'] for segment, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]: Traceback (most recent call last):
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:     timer()
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:     cb(*args, **kw)
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:     return func(*args, **kwargs)
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:     self._notify()
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:     self.callback(batched_events)
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:     event.method(event)
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:     aggregate_uuid = self.p_client.list_aggregates(
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:     return f(self, *a, **k)
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self._get(url).json()
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self.request(url, 'GET', **kwargs)
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:     base_url = self.get_endpoint(auth, allow=allow,
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 31 16:25:56.384597 dv-cinder-793814-1-iscsi neutron-server[91763]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 31 16:25:56.401982 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: fce86ab6-1557-4a78-936b-fe27e15e00ac {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:25:56.402341 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device fce86ab6-1557-4a78-936b-fe27e15e00ac not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:25:56.402766 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device a225a2ee-fc85-4ac1-9115-01b63bb0296a no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:25:56.433653 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-092e63fe-23a8-42ec-86aa-3d7d318e2477 None None] Pushing event deleted for resources: {'Port': ['ID=fce86ab6-1557-4a78-936b-fe27e15e00ac,revision_number=None']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:56.435446 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-092e63fe-23a8-42ec-86aa-3d7d318e2477 None None] No DVR routers for this DVR port fce86ab6-1557-4a78-936b-fe27e15e00ac on host dv-cinder-793814-1-iscsi {{(pid=91765) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:25:56.441891 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-092e63fe-23a8-42ec-86aa-3d7d318e2477 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:56.443186 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: a225a2ee-fc85-4ac1-9115-01b63bb0296a {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:25:56.443530 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device a225a2ee-fc85-4ac1-9115-01b63bb0296a not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:25:56.463902 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16621775'] for network, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:56.467664 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:56.481071 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:56.491803 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] Pushing event deleted for resources: {'Network': ['ID=e3df5118-0a40-4a66-b31c-a978a0c899cf,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:56.495967 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:56.499346 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] 10.222.0.43 "DELETE /v2.0/networks/e3df5118-0a40-4a66-b31c-a978a0c899cf HTTP/1.1" status: 204  len: 168 time: 0.9919841
May 31 16:25:56.502429 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 36324) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:57.032996 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d18be2e2-f8d1-40ad-b4fc-1668c1d8d145 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-16627919'] for router_interface, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:57.141690 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c998ba50-8974-4660-8d11-4ba0bfd8d6da req-75c631a6-7bc2-42f2-a274-31c3fbe80c09 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:57.144296 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c998ba50-8974-4660-8d11-4ba0bfd8d6da req-75c631a6-7bc2-42f2-a274-31c3fbe80c09 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.0865681
May 31 16:25:57.190684 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c998ba50-8974-4660-8d11-4ba0bfd8d6da req-acc4b654-d8c6-4162-bd99-ac715807b07e tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0407400
May 31 16:25:57.545638 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-d18be2e2-f8d1-40ad-b4fc-1668c1d8d145 admin admin] Deleting port 1da6e62c-8254-4b52-9755-bf21e7ceacdf {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:25:57.546252 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d18be2e2-f8d1-40ad-b4fc-1668c1d8d145 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:57.664679 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [None req-d18be2e2-f8d1-40ad-b4fc-1668c1d8d145 admin admin] For port 1da6e62c-8254-4b52-9755-bf21e7ceacdf, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=1da6e62c-8254-4b52-9755-bf21e7ceacdf,segment=NetworkSegment(b72084f1-c698-4897-bb6d-f45dadd02fbd),segment_id=b72084f1-c698-4897-bb6d-f45dadd02fbd)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:25:57.665057 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d18be2e2-f8d1-40ad-b4fc-1668c1d8d145 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:57.788859 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-d18be2e2-f8d1-40ad-b4fc-1668c1d8d145 admin admin] Calling delete_port for 1da6e62c-8254-4b52-9755-bf21e7ceacdf owned by network:router_interface {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:25:57.954766 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d18be2e2-f8d1-40ad-b4fc-1668c1d8d145 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:57.959926 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-9a68df45-dd0d-4626-b1a3-ea357a75744e tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:25:58.006956 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d18be2e2-f8d1-40ad-b4fc-1668c1d8d145 admin admin] Pushing event deleted for resources: {'Port': ['ID=1da6e62c-8254-4b52-9755-bf21e7ceacdf,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:25:58.010098 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d18be2e2-f8d1-40ad-b4fc-1668c1d8d145 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:25:58.292487 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d18be2e2-f8d1-40ad-b4fc-1668c1d8d145 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-16317375', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-16625247'] for router_interface, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:58.393548 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-787bbac7-1266-440f-b9f6-841ad981cd2b req-165c0f28-8206-4f97-91da-9059b0f8f631 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:58.394924 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-787bbac7-1266-440f-b9f6-841ad981cd2b req-165c0f28-8206-4f97-91da-9059b0f8f631 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.0900376
May 31 16:25:58.441338 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-787bbac7-1266-440f-b9f6-841ad981cd2b req-4dff035d-64ae-487a-811b-59ce799a8e7c tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0406914
May 31 16:25:58.667075 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d18be2e2-f8d1-40ad-b4fc-1668c1d8d145 admin admin] Router 1d03fb4c-8bb7-46ac-916b-6c44e5689b95 has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91763) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:25:58.959740 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d18be2e2-f8d1-40ad-b4fc-1668c1d8d145 admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:25:58.969556 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-d18be2e2-f8d1-40ad-b4fc-1668c1d8d145 admin admin] 10.222.0.43 "PUT /v2.0/routers/1d03fb4c-8bb7-46ac-916b-6c44e5689b95/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.4660294
May 31 16:25:58.972680 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d442b679-d265-451d-b460-be3d16c26cdd None None] Sync routers for ids ['1d03fb4c-8bb7-46ac-916b-6c44e5689b95'] in dv-cinder-793814-1-iscsi {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:25:58.973198 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36342) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:25:58.997455 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d442b679-d265-451d-b460-be3d16c26cdd None None] Routers {'1d03fb4c-8bb7-46ac-916b-6c44e5689b95'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:25:58.998462 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-d442b679-d265-451d-b460-be3d16c26cdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426f0c3d0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:25:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['1d03fb4c-8bb7-46ac-916b-6c44e5689b95'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:59.238729 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-d442b679-d265-451d-b460-be3d16c26cdd None None] Set router 1d03fb4c-8bb7-46ac-916b-6c44e5689b95 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:25:59.292050 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-62f9bed6-28a6-4d0c-9ce7-74d5d2c6473a admin admin] Notify callbacks [] for router, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:59.487063 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-62f9bed6-28a6-4d0c-9ce7-74d5d2c6473a admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:59.555221 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-d442b679-d265-451d-b460-be3d16c26cdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426f0c3d0>, [{'id': '1d03fb4c-8bb7-46ac-916b-6c44e5689b95', 'name': 'tempest-TestMinimumBasicScenario-348591781-router', 'tenant_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.70'}], 'enable_snat': True}, 'gw_port_id': '2f39560e-c0eb-445a-ab3c-55c4c613178f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:43Z', 'updated_at': '2021-05-31T16:25:57Z', 'revision_number': 5, 'project_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'gw_port': {'id': '2f39560e-c0eb-445a-ab3c-55c4c613178f', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:7a:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1d03fb4c-8bb7-46ac-916b-6c44e5689b95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 340, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:44Z', 'updated_at': '2021-05-31T16:21:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:59.559251 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d442b679-d265-451d-b460-be3d16c26cdd None None] Checking router: 1d03fb4c-8bb7-46ac-916b-6c44e5689b95 for host: dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:25:59.568660 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d442b679-d265-451d-b460-be3d16c26cdd None None] Routers {'1d03fb4c-8bb7-46ac-916b-6c44e5689b95'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:25:59.569338 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-d442b679-d265-451d-b460-be3d16c26cdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426f0c3d0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:25:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['1d03fb4c-8bb7-46ac-916b-6c44e5689b95'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:59.630472 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-62f9bed6-28a6-4d0c-9ce7-74d5d2c6473a admin admin] Deleting port 2f39560e-c0eb-445a-ab3c-55c4c613178f {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:25:59.630819 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-62f9bed6-28a6-4d0c-9ce7-74d5d2c6473a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:59.729245 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-d442b679-d265-451d-b460-be3d16c26cdd None None] Set router 1d03fb4c-8bb7-46ac-916b-6c44e5689b95 gateway port host: None {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:25:59.729907 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec4a0f0b-72d1-48c5-81fc-df2f070dd6a4 req-209ff7a2-bb3d-4a4b-b94b-53b85eb75aef tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:25:59.731411 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ec4a0f0b-72d1-48c5-81fc-df2f070dd6a4 req-209ff7a2-bb3d-4a4b-b94b-53b85eb75aef tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.1745644
May 31 16:25:59.802176 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [None req-62f9bed6-28a6-4d0c-9ce7-74d5d2c6473a admin admin] For port 2f39560e-c0eb-445a-ab3c-55c4c613178f, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=2f39560e-c0eb-445a-ab3c-55c4c613178f,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:25:59.802572 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-62f9bed6-28a6-4d0c-9ce7-74d5d2c6473a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:25:59.821028 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ec4a0f0b-72d1-48c5-81fc-df2f070dd6a4 req-2da4a80c-5627-4046-8ff0-2696ec591988 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0725987
May 31 16:25:59.847123 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-d442b679-d265-451d-b460-be3d16c26cdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426f0c3d0>, [{'id': '1d03fb4c-8bb7-46ac-916b-6c44e5689b95', 'name': 'tempest-TestMinimumBasicScenario-348591781-router', 'tenant_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:43Z', 'updated_at': '2021-05-31T16:25:59Z', 'revision_number': 6, 'project_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'gw_port_host': None}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:25:59.851446 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d442b679-d265-451d-b460-be3d16c26cdd None None] The sync data for ids ['1d03fb4c-8bb7-46ac-916b-6c44e5689b95'] in dv-cinder-793814-1-iscsi is: [{'id': '1d03fb4c-8bb7-46ac-916b-6c44e5689b95', 'name': 'tempest-TestMinimumBasicScenario-348591781-router', 'tenant_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:43Z', 'updated_at': '2021-05-31T16:25:59Z', 'revision_number': 6, 'project_id': 'b8bc8f93c5a94a43bcb5b1f62b1e677f', 'gw_port_host': None}] {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:25:59.941814 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-62f9bed6-28a6-4d0c-9ce7-74d5d2c6473a admin admin] Calling delete_port for 2f39560e-c0eb-445a-ab3c-55c4c613178f owned by network:router_gateway {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:26:00.102757 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-62f9bed6-28a6-4d0c-9ce7-74d5d2c6473a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:00.108358 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-58fe3ec7-70d6-44a4-8ac2-d8cc3d72ad79 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:00.158890 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62f9bed6-28a6-4d0c-9ce7-74d5d2c6473a admin admin] Pushing event deleted for resources: {'Port': ['ID=2f39560e-c0eb-445a-ab3c-55c4c613178f,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:00.162477 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-62f9bed6-28a6-4d0c-9ce7-74d5d2c6473a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:00.262848 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-62f9bed6-28a6-4d0c-9ce7-74d5d2c6473a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-16621778'] for router_gateway, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:00.440672 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-62f9bed6-28a6-4d0c-9ce7-74d5d2c6473a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-16623711', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-683'] for router, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:00.442967 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-62f9bed6-28a6-4d0c-9ce7-74d5d2c6473a admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:00.530666 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-62f9bed6-28a6-4d0c-9ce7-74d5d2c6473a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-16623971'] for router, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:00.531301 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-62f9bed6-28a6-4d0c-9ce7-74d5d2c6473a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 1d03fb4c-8bb7-46ac-916b-6c44e5689b95 {{(pid=91764) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 31 16:26:00.545387 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-62f9bed6-28a6-4d0c-9ce7-74d5d2c6473a admin admin] Notify callbacks [] for router, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:00.546457 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-62f9bed6-28a6-4d0c-9ce7-74d5d2c6473a admin admin] 10.222.0.43 "DELETE /v2.0/routers/1d03fb4c-8bb7-46ac-916b-6c44e5689b95 HTTP/1.1" status: 204  len: 168 time: 1.5723329
May 31 16:26:00.549053 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36360) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:00.617149 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_v2 [None req-5ac23c4f-7dbb-429d-9d8a-26b429c8a0ae admin admin] Deleting subnet 19349b15-7a29-4559-912d-95f2c3f6c489 {{(pid=91764) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 31 16:26:00.620612 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5ac23c4f-7dbb-429d-9d8a-26b429c8a0ae admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:00.641060 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 1da6e62c-8254-4b52-9755-bf21e7ceacdf no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:26:00.680402 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5ac23c4f-7dbb-429d-9d8a-26b429c8a0ae admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14907384'] for subnet, precommit_delete_associations {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:00.696463 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: 1da6e62c-8254-4b52-9755-bf21e7ceacdf {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:26:00.696814 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 1da6e62c-8254-4b52-9755-bf21e7ceacdf not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:26:00.806390 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5ac23c4f-7dbb-429d-9d8a-26b429c8a0ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-975336'] for subnet, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:01.184418 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c893237-a85b-45ca-8e2b-db2d25cc5f0a req-daa13a3b-f31e-42b8-9e06-ef580006db32 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:01.185984 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4c893237-a85b-45ca-8e2b-db2d25cc5f0a req-daa13a3b-f31e-42b8-9e06-ef580006db32 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.2316208
May 31 16:26:01.301335 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4c893237-a85b-45ca-8e2b-db2d25cc5f0a req-1f31dd30-e444-4192-afaf-8e6b1076156c tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1027174
May 31 16:26:01.333075 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5ac23c4f-7dbb-429d-9d8a-26b429c8a0ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-978269', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14907170', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14793691'] for subnet, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:01.340271 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:01.376713 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ac23c4f-7dbb-429d-9d8a-26b429c8a0ae admin admin] Pushing event deleted for resources: {'Subnet': ['ID=19349b15-7a29-4559-912d-95f2c3f6c489,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:01.380331 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-5ac23c4f-7dbb-429d-9d8a-26b429c8a0ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:01.381297 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5ac23c4f-7dbb-429d-9d8a-26b429c8a0ae admin admin] Notify callbacks [] for subnet, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:01.386654 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb1d551f-0f84-4967-94ec-22c54806e123 None None] Network ebb8f1cc-6c15-416d-995e-90978c0e9eac requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:26:01.388511 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-5ac23c4f-7dbb-429d-9d8a-26b429c8a0ae admin admin] 10.222.0.43 "DELETE /v2.0/subnets/19349b15-7a29-4559-912d-95f2c3f6c489 HTTP/1.1" status: 204  len: 168 time: 0.8381877
May 31 16:26:01.390587 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36370) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:01.503712 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-525980'] for network, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:01.580956 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] Deleting port e9ece5ff-8846-4f48-8d10-1021be81f9e5 {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:26:01.581745 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:01.634517 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-596c0306-c563-4c98-a872-43435ad01140 None None] DHCP port deletion for ebb8f1cc-6c15-416d-995e-90978c0e9eac request from dv-cinder-793814-1-iscsi {{(pid=91765) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 31 16:26:01.694354 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] For port e9ece5ff-8846-4f48-8d10-1021be81f9e5, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=e9ece5ff-8846-4f48-8d10-1021be81f9e5,segment=NetworkSegment(b72084f1-c698-4897-bb6d-f45dadd02fbd),segment_id=b72084f1-c698-4897-bb6d-f45dadd02fbd)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:26:01.694354 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:01.706908 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-596c0306-c563-4c98-a872-43435ad01140 None None] Deleting port e9ece5ff-8846-4f48-8d10-1021be81f9e5 {{(pid=91765) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:26:01.707504 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-596c0306-c563-4c98-a872-43435ad01140 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:01.812438 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-596c0306-c563-4c98-a872-43435ad01140 None None] For port e9ece5ff-8846-4f48-8d10-1021be81f9e5, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=e9ece5ff-8846-4f48-8d10-1021be81f9e5,segment=NetworkSegment(b72084f1-c698-4897-bb6d-f45dadd02fbd),segment_id=b72084f1-c698-4897-bb6d-f45dadd02fbd)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:26:01.812898 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-596c0306-c563-4c98-a872-43435ad01140 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:01.828705 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] Calling delete_port for e9ece5ff-8846-4f48-8d10-1021be81f9e5 owned by network:dhcp {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:26:01.893448 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:01.899759 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-55daac37-51dc-4837-8100-9ec2def05dc6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:01.947686 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] Pushing event deleted for resources: {'Port': ['ID=e9ece5ff-8846-4f48-8d10-1021be81f9e5,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:01.950920 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:01.951749 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] No DVR routers for this DVR port e9ece5ff-8846-4f48-8d10-1021be81f9e5 on host dv-cinder-793814-1-iscsi {{(pid=91764) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:26:01.986942 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-596c0306-c563-4c98-a872-43435ad01140 None None] Calling delete_port for e9ece5ff-8846-4f48-8d10-1021be81f9e5 owned by network:dhcp {{(pid=91765) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:26:02.038674 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-596c0306-c563-4c98-a872-43435ad01140 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907'] for port, after_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:02.042348 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:02.077589 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-988775', 'neutron.services.segments.db._delete_segments_for_network-8732784586204'] for network, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:02.087984 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-596c0306-c563-4c98-a872-43435ad01140 None None] Pushing event deleted for resources: {'Port': ['ID=e9ece5ff-8846-4f48-8d10-1021be81f9e5,revision_number=None']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:02.089845 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-596c0306-c563-4c98-a872-43435ad01140 None None] No DVR routers for this DVR port e9ece5ff-8846-4f48-8d10-1021be81f9e5 on host dv-cinder-793814-1-iscsi {{(pid=91765) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:26:02.091227 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-596c0306-c563-4c98-a872-43435ad01140 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:02.103741 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f14251e8f10>,) {'filters': {'network_id': ['ebb8f1cc-6c15-416d-995e-90978c0e9eac']}} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:26:02.122203 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f14251e8f10>, 'b72084f1-c698-4897-bb6d-f45dadd02fbd') {'for_net_delete': True} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:26:02.122490 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f14251e8f10>, 'b72084f1-c698-4897-bb6d-f45dadd02fbd') {} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:26:02.136013 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732784599197', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14907379'] for segment, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:02.156359 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:02.164791 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] Releasing vlan 804 on physical network physnet1 to pool {{(pid=91764) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 31 16:26:02.165260 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14905732'] for segment, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]: Traceback (most recent call last):
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:     timer()
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:     cb(*args, **kw)
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:     return func(*args, **kwargs)
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:     self._notify()
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:     self.callback(batched_events)
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:     event.method(event)
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:     aggregate_uuid = self.p_client.list_aggregates(
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:     return f(self, *a, **k)
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self._get(url).json()
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self.request(url, 'GET', **kwargs)
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:     base_url = self.get_endpoint(auth, allow=allow,
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 31 16:26:02.179906 dv-cinder-793814-1-iscsi neutron-server[91764]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 31 16:26:02.262332 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16621775'] for network, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:02.266377 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:02.284268 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:02.295295 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] Pushing event deleted for resources: {'Network': ['ID=ebb8f1cc-6c15-416d-995e-90978c0e9eac,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:02.297985 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:02.308591 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-c74298c4-c72e-48d1-a8d5-d67f4686e4c1 admin admin] 10.222.0.43 "DELETE /v2.0/networks/ebb8f1cc-6c15-416d-995e-90978c0e9eac HTTP/1.1" status: 204  len: 168 time: 0.9142270
May 31 16:26:02.337367 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device e9ece5ff-8846-4f48-8d10-1021be81f9e5 no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:26:02.387774 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: e9ece5ff-8846-4f48-8d10-1021be81f9e5 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:26:02.388029 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device e9ece5ff-8846-4f48-8d10-1021be81f9e5 not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:26:02.388805 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 2f39560e-c0eb-445a-ab3c-55c4c613178f no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:26:02.424689 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: 2f39560e-c0eb-445a-ab3c-55c4c613178f {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:26:02.424936 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 2f39560e-c0eb-445a-ab3c-55c4c613178f not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:26:02.513566 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e683fa7d-2513-4d11-8dc5-fb5b95106d17 req-ab3d66b2-bb44-4608-a23b-bb1fdf293f02 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:02.514922 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e683fa7d-2513-4d11-8dc5-fb5b95106d17 req-ab3d66b2-bb44-4608-a23b-bb1fdf293f02 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.0894308
May 31 16:26:02.524429 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 36386) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:02.563360 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e683fa7d-2513-4d11-8dc5-fb5b95106d17 req-bae37069-7073-4354-b892-93346b678a23 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0423825
May 31 16:26:02.575224 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-0629ca97-4765-4842-abe5-8f25138f7e4c admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=8e66b29e29094a429643e0308704753b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0495646
May 31 16:26:02.577645 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 36390) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:02.651739 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-076208dd-6b2d-4a01-9a57-46c5261667ba admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:02.679374 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-076208dd-6b2d-4a01-9a57-46c5261667ba admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:02.734122 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-076208dd-6b2d-4a01-9a57-46c5261667ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:02.738892 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d023b9b7-1da7-4815-8c6d-2b7f74b23bcd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:02.753082 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-076208dd-6b2d-4a01-9a57-46c5261667ba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=36428dc9-0862-4d53-8a33-6b298f5353c7,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:02.756038 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-076208dd-6b2d-4a01-9a57-46c5261667ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:02.765282 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-076208dd-6b2d-4a01-9a57-46c5261667ba admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:02.766490 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-076208dd-6b2d-4a01-9a57-46c5261667ba admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/36428dc9-0862-4d53-8a33-6b298f5353c7 HTTP/1.1" status: 204  len: 168 time: 0.1878989
May 31 16:26:03.181459 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36404) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:03.234684 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-7c62fa17-0ede-4e62-8066-128d97c40062 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=b8bc8f93c5a94a43bcb5b1f62b1e677f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0519710
May 31 16:26:03.237740 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36408) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:03.308020 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f0f43ce3-bcbe-476c-8783-5b82b0935b11 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:03.341957 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f0f43ce3-bcbe-476c-8783-5b82b0935b11 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:03.395072 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f0f43ce3-bcbe-476c-8783-5b82b0935b11 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:03.399354 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-4b4367b1-138d-4cab-9ad3-0999bb420a96 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:03.410900 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0f43ce3-bcbe-476c-8783-5b82b0935b11 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c3467fea-2498-41e3-aeb8-e428960dfb35,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:03.414452 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-f0f43ce3-bcbe-476c-8783-5b82b0935b11 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:03.418068 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-f0f43ce3-bcbe-476c-8783-5b82b0935b11 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:03.419189 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-f0f43ce3-bcbe-476c-8783-5b82b0935b11 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/c3467fea-2498-41e3-aeb8-e428960dfb35 HTTP/1.1" status: 204  len: 168 time: 0.1803694
May 31 16:26:03.756003 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf6848f1-dfcd-476e-8944-7fd1e867481c req-f21bc16f-241d-441d-968f-166c15c22f9e tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:03.757658 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bf6848f1-dfcd-476e-8944-7fd1e867481c req-f21bc16f-241d-441d-968f-166c15c22f9e tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.0824211
May 31 16:26:03.805254 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bf6848f1-dfcd-476e-8944-7fd1e867481c req-177c2e9b-399b-4495-a07c-ffc85f6207da tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0416901
May 31 16:26:04.254354 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 36440) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:04.400412 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-844578684-network', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:26:04.408561 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:26:04.414573 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Usage tracker for resource:network and tenant:ff0bbba58394409987a388bb38868b4e is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:26:04.418203 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:26:04.427200 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:26:04.440342 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Made reservation on behalf of ff0bbba58394409987a388bb38868b4e for: {'network': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:26:04.444547 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-639279'] for network, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:04.468714 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:04.486910 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:26:04.491269 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Usage tracker for resource:security_group_rule and tenant:ff0bbba58394409987a388bb38868b4e is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:26:04.494255 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:26:04.500497 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:26:04.559220 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36448) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:04.591800 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:04.597667 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:04.612482 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 823}  {{(pid=91763) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 31 16:26:04.622880 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:04.623341 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.segments_db [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Added segment 1e70bee6-dfc7-4037-8e59-6c6e25de8649 of type vlan for network 0e202b3d-d60d-481f-bf3a-e31943668c98
May 31 16:26:04.655961 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732784079930'] for network, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:04.680153 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-86f42044-279f-458f-8918-e43b5d14d8f7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:04.725316 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366'] for network, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:04.727587 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:04.728414 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:04.733332 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=673801e7-27c1-44ad-bc6a-66fccef69f67,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:04.737812 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:04.742856 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.007s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:04.770013 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bdc20f59-65cc-415e-88ce-d102ea00d7e0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:04.791633 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-bdc20f59-65cc-415e-88ce-d102ea00d7e0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:26:04.795781 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-bdc20f59-65cc-415e-88ce-d102ea00d7e0 admin admin] Usage tracker for resource:security_group_rule and tenant:a66e76a4b6fb41e29b17d82a0ae9ab21 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:26:04.799371 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-bdc20f59-65cc-415e-88ce-d102ea00d7e0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:26:04.807931 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-bdc20f59-65cc-415e-88ce-d102ea00d7e0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:26:04.841781 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 0.5851576
May 31 16:26:04.845138 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 36458) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:04.853412 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-216ae201-a085-4926-ad8e-74ab9ddf9ddf admin admin] Request body: {'subnet': {'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-844578684-subnet', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'ip_version': 4}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:26:04.860813 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-216ae201-a085-4926-ad8e-74ab9ddf9ddf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:26:04.868066 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Pushing event updated for resources: {'Network': ['ID=0e202b3d-d60d-481f-bf3a-e31943668c98,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:04.870579 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-216ae201-a085-4926-ad8e-74ab9ddf9ddf admin admin] Usage tracker for resource:subnet and tenant:ff0bbba58394409987a388bb38868b4e is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:26:04.873738 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:04.874553 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-216ae201-a085-4926-ad8e-74ab9ddf9ddf admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:26:04.880208 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Network 0e202b3d-d60d-481f-bf3a-e31943668c98 details requested by agent ovs-agent-dv-cinder-793814-1-iscsi with host dv-cinder-793814-1-iscsi {{(pid=91765) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 31 16:26:04.881814 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-216ae201-a085-4926-ad8e-74ab9ddf9ddf admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:26:04.895097 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-216ae201-a085-4926-ad8e-74ab9ddf9ddf admin admin] Made reservation on behalf of ff0bbba58394409987a388bb38868b4e for: {'subnet': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:26:04.899126 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-216ae201-a085-4926-ad8e-74ab9ddf9ddf admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-13992668'] for subnet, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:05.017070 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-02bcc4dc-08dd-47b2-b879-e3201fc98c40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:05.041799 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bdc20f59-65cc-415e-88ce-d102ea00d7e0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:05.046531 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bdc20f59-65cc-415e-88ce-d102ea00d7e0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:05.054030 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-51e68ff5-a5fa-42bb-9db6-6239ed66a2bb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:05.112515 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdc20f59-65cc-415e-88ce-d102ea00d7e0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7a720095-9a2d-4aef-a232-421a3f4bc622,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:05.116851 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-bdc20f59-65cc-415e-88ce-d102ea00d7e0 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=a66e76a4b6fb41e29b17d82a0ae9ab21&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5565794
May 31 16:26:05.117923 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-bdc20f59-65cc-415e-88ce-d102ea00d7e0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:05.119637 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36462) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:05.246508 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55c96660-d076-4534-890f-6cb81ee2e081 req-f70cb787-095a-4445-ae27-fa887335eba1 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:05.247922 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-55c96660-d076-4534-890f-6cb81ee2e081 req-f70cb787-095a-4445-ae27-fa887335eba1 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.3003235
May 31 16:26:05.330953 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-55c96660-d076-4534-890f-6cb81ee2e081 req-7aedbaac-01ef-4cc1-a681-872f01a3cdf4 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0701082
May 31 16:26:05.333510 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-faf97f01-da86-490e-81d9-d37aeb80c56b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:05.342877 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-216ae201-a085-4926-ad8e-74ab9ddf9ddf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-14336643', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-13992650'] for subnet, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:05.348023 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:05.365454 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-faf97f01-da86-490e-81d9-d37aeb80c56b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:05.421147 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-216ae201-a085-4926-ad8e-74ab9ddf9ddf admin admin] Pushing event updated for resources: {'Subnet': ['ID=20f6caad-2e13-4108-af8f-f9c2336ccde2,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:05.425495 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-216ae201-a085-4926-ad8e-74ab9ddf9ddf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:05.432226 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-216ae201-a085-4926-ad8e-74ab9ddf9ddf admin admin] Checking segment: {'id': '1e70bee6-dfc7-4037-8e59-6c6e25de8649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 823, 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91763) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:26:05.432839 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-216ae201-a085-4926-ad8e-74ab9ddf9ddf admin admin] Network hostable DHCP agents. Network: 0e202b3d-d60d-481f-bf3a-e31943668c98, hostable agents: ['5c9859e8-5965-4c86-8b2b-8fab235cbf66'], hosted agents: [] {{(pid=91763) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 31 16:26:05.437937 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-faf97f01-da86-490e-81d9-d37aeb80c56b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:05.444644 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-f9ee75f3-dee4-47c1-8525-28126fbc04a9 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:05.457090 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-216ae201-a085-4926-ad8e-74ab9ddf9ddf admin admin] Network 0e202b3d-d60d-481f-bf3a-e31943668c98 is scheduled to be hosted by DHCP agent 5c9859e8-5965-4c86-8b2b-8fab235cbf66 with binding_index 1 {{(pid=91763) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 31 16:26:05.459361 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faf97f01-da86-490e-81d9-d37aeb80c56b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a720095-9a2d-4aef-a232-421a3f4bc622,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:05.462334 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-faf97f01-da86-490e-81d9-d37aeb80c56b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:05.470378 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-faf97f01-da86-490e-81d9-d37aeb80c56b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:05.472895 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-faf97f01-da86-490e-81d9-d37aeb80c56b admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/7a720095-9a2d-4aef-a232-421a3f4bc622 HTTP/1.1" status: 204  len: 168 time: 0.3522809
May 31 16:26:05.476126 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-216ae201-a085-4926-ad8e-74ab9ddf9ddf admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793814-1-iscsi, 0e202b3d-d60d-481f-bf3a-e31943668c98) {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:26:05.491548 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-216ae201-a085-4926-ad8e-74ab9ddf9ddf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:05.491943 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7edef55-ab0d-484f-8508-4d9c96001a01 None None] Network 0e202b3d-d60d-481f-bf3a-e31943668c98 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:26:05.492963 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-216ae201-a085-4926-ad8e-74ab9ddf9ddf admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:05.523181 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-216ae201-a085-4926-ad8e-74ab9ddf9ddf admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 844 time: 0.6762519
May 31 16:26:05.527086 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36474) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:05.536802 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-844578684-router', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:26:05.545224 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:26:05.552824 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Usage tracker for resource:router and tenant:ff0bbba58394409987a388bb38868b4e is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:26:05.559071 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:26:05.569487 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:26:05.596444 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-16623804', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-697'] for router, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:05.603010 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-16618684', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-16621667', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-16430734', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-672'] for router, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:05.632061 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:05.874444 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp87ca72be-1027-56d4-a8d3-ba9dae998815-0e202b3d-d60d-481f-bf3a-e31943668c98', 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'fixed_ips': [{'subnet_id': '20f6caad-2e13-4108-af8f-f9c2336ccde2'}]}} from dv-cinder-793814-1-iscsi. {{(pid=91765) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 31 16:26:05.875568 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:06.059981 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16621638', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16623758', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-722'] for router, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:06.060447 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.db_base_plugin_common [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Allocated IP 172.20.0.2 (0e202b3d-d60d-481f-bf3a-e31943668c98/20f6caad-2e13-4108-af8f-f9c2336ccde2/8bb259a5-2a36-4eb3-9fe6-00460cc552fe) {{(pid=91765) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:26:06.109848 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29f5e57c-e839-43c7-9959-be11b29f21a2 req-429aa4dc-7796-4562-8668-38eb4608d07c tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:06.112124 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-29f5e57c-e839-43c7-9959-be11b29f21a2 req-429aa4dc-7796-4562-8668-38eb4608d07c tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.4551811
May 31 16:26:06.182892 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a85db018-db7c-412b-a613-71e1b6fb1917 req-860da5a3-c59f-4324-a279-118a48ea7982 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:06.184364 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a85db018-db7c-412b-a613-71e1b6fb1917 req-860da5a3-c59f-4324-a279-118a48ea7982 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=a56002dfed61485aa4d9e237932e1abf&device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 1098 time: 0.3961709
May 31 16:26:06.284501 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Notify callbacks [] for port, precommit_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:06.296195 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Transition to ACTIVE for port object 8bb259a5-2a36-4eb3-9fe6-00460cc552fe will not be triggered until provisioned by entity L2. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:26:06.318884 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Transition to ACTIVE for port object 8bb259a5-2a36-4eb3-9fe6-00460cc552fe will not be triggered until provisioned by entity DHCP. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:26:06.321007 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-29f5e57c-e839-43c7-9959-be11b29f21a2 req-2cba0051-203a-4189-aa98-c18d0107ab31 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2009556
May 31 16:26:06.327343 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:06.332656 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:06.377825 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a85db018-db7c-412b-a613-71e1b6fb1917 req-151f7fe2-4b92-4b47-bd63-49b393f67112 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:06.379428 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a85db018-db7c-412b-a613-71e1b6fb1917 req-151f7fe2-4b92-4b47-bd63-49b393f67112 service neutron] 10.222.0.63 "GET /v2.0/networks?id=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 HTTP/1.1" status: 200  len: 911 time: 0.1826153
May 31 16:26:06.400542 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Network 0e202b3d-d60d-481f-bf3a-e31943668c98 is already hosted by enough agents. {{(pid=91765) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:26:06.403683 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.scheduler.base_scheduler [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Resources bound (agent type, host, resource id):  {{(pid=91765) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:26:06.407618 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Received port after_create {{(pid=91765) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:26:06.414011 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Pushing event updated for resources: {'Port': ['ID=8bb259a5-2a36-4eb3-9fe6-00460cc552fe,revision_number=1']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:06.418207 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:06.511850 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Attempting to bind port 8bb259a5-2a36-4eb3-9fe6-00460cc552fe on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:26:06.512220 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Attempting to bind port 8bb259a5-2a36-4eb3-9fe6-00460cc552fe by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '1e70bee6-dfc7-4037-8e59-6c6e25de8649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 823, 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98'}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:26:06.512585 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Attempting to bind port 8bb259a5-2a36-4eb3-9fe6-00460cc552fe on network 0e202b3d-d60d-481f-bf3a-e31943668c98 {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:26:06.518144 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 25, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:26:06.518530 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Checking segment: {'id': '1e70bee6-dfc7-4037-8e59-6c6e25de8649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 823, 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91765) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:26:06.518931 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:06.519321 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Bound using segment: {'id': '1e70bee6-dfc7-4037-8e59-6c6e25de8649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 823, 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98'} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:26:06.519804 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Bound port: 8bb259a5-2a36-4eb3-9fe6-00460cc552fe, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1e70bee6-dfc7-4037-8e59-6c6e25de8649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 823, 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98'}}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:26:06.520244 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:06.555528 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a85db018-db7c-412b-a613-71e1b6fb1917 req-107179ed-b9ba-43e4-8c50-75cd1a5421b7 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=cd88a910-8740-4a3f-aafb-41a504f611ee HTTP/1.1" status: 200  len: 1000 time: 0.1642818
May 31 16:26:06.612130 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] For port 8bb259a5-2a36-4eb3-9fe6-00460cc552fe, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91765) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:26:06.615994 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] For port 8bb259a5-2a36-4eb3-9fe6-00460cc552fe, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=8bb259a5-2a36-4eb3-9fe6-00460cc552fe,segment=NetworkSegment(1e70bee6-dfc7-4037-8e59-6c6e25de8649),segment_id=1e70bee6-dfc7-4037-8e59-6c6e25de8649)] {{(pid=91765) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:26:06.622532 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:06.629120 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:06.719951 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Pushing event updated for resources: {'Port': ['ID=8bb259a5-2a36-4eb3-9fe6-00460cc552fe,revision_number=2']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:06.724183 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:06.731953 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a85db018-db7c-412b-a613-71e1b6fb1917 req-b9fdac1c-1be8-4cc6-9a31-452f099f541c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:06.733409 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a85db018-db7c-412b-a613-71e1b6fb1917 req-b9fdac1c-1be8-4cc6-9a31-452f099f541c service neutron] 10.222.0.63 "GET /v2.0/subnets?id=6489943b-1236-4d7c-80a7-58ef5aedf09d HTTP/1.1" status: 200  len: 849 time: 0.1697679
May 31 16:26:06.826943 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:06.863290 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:07.160559 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a85db018-db7c-412b-a613-71e1b6fb1917 req-e2c70b29-2a06-4766-978c-0dccbbd7fe3a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:07.162113 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a85db018-db7c-412b-a613-71e1b6fb1917 req-e2c70b29-2a06-4766-978c-0dccbbd7fe3a service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.4189267
May 31 16:26:07.211107 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Allocated IP 172.27.0.74 (00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c/96709d85-d0fe-4cf8-b232-eaf6b143ebe6/dc058e78-0721-4760-9e77-06b3f85979b7) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:26:07.410234 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a85db018-db7c-412b-a613-71e1b6fb1917 req-54993d12-446b-4d55-a8b9-cae78e2334c7 service neutron] 10.222.0.63 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2375054
May 31 16:26:07.603132 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:07.647605 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e642711e-cb45-4549-aa03-8247408da4ac None None] Network 0e202b3d-d60d-481f-bf3a-e31943668c98 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:26:07.672278 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a85db018-db7c-412b-a613-71e1b6fb1917 req-17b09b0b-4c11-421d-8d23-90869717ff98 service neutron] 10.222.0.63 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2466018
May 31 16:26:07.688038 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f024aea-527b-464d-841f-d40aca3d47b5 req-f0afb171-8015-430f-8c48-e82d95d48942 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:07.689160 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1f024aea-527b-464d-841f-d40aca3d47b5 req-f0afb171-8015-430f-8c48-e82d95d48942 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.2409668
May 31 16:26:07.717367 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:07.723518 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-325d73d6-6d6e-4914-ab83-d6747d184791 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:07.744714 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-b5064912-f9d0-42e5-9b08-a9426f62e2c6 None None] Provisioning for port 8bb259a5-2a36-4eb3-9fe6-00460cc552fe completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:26:07.809906 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1f024aea-527b-464d-841f-d40aca3d47b5 req-7e727999-5754-4c0a-b56b-d2b97bbe442e tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1128469
May 31 16:26:07.814932 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:26:07.815942 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Pushing event updated for resources: {'Port': ['ID=dc058e78-0721-4760-9e77-06b3f85979b7,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:07.818893 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:26:07.821348 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:07.822036 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:26:07.906162 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:08.166651 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:26:08.257004 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-00ab8b2f-1715-4013-8191-f663f2c87c2a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:08.281224 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:08.371062 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 8bb259a5-2a36-4eb3-9fe6-00460cc552fe up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:26:08.447920 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port 8bb259a5-2a36-4eb3-9fe6-00460cc552fe completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:26:08.452484 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 8bb259a5-2a36-4eb3-9fe6-00460cc552fe triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:26:08.452871 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:08.574831 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:08.610111 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port 8bb259a5-2a36-4eb3-9fe6-00460cc552fe, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=8bb259a5-2a36-4eb3-9fe6-00460cc552fe,segment=NetworkSegment(1e70bee6-dfc7-4037-8e59-6c6e25de8649),segment_id=1e70bee6-dfc7-4037-8e59-6c6e25de8649)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:26:08.615367 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:08.618822 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:08.698150 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=8bb259a5-2a36-4eb3-9fe6-00460cc552fe,revision_number=3']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:08.701542 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:08.783661 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-16623797', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16621573'] for router, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:09.068846 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-309f0bde-6b80-4430-9d0b-32ba3c4c1c32 req-0c58ea72-d0e8-4166-95cf-3610393620ec tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:09.070419 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-309f0bde-6b80-4430-9d0b-32ba3c4c1c32 req-0c58ea72-d0e8-4166-95cf-3610393620ec tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.1376956
May 31 16:26:09.076371 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Router 9e698298-b838-4dbb-939c-c84fb0148003 is scheduled to L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e with binding_index 1 {{(pid=91764) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 31 16:26:09.162356 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:09.208222 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-309f0bde-6b80-4430-9d0b-32ba3c4c1c32 req-a9aa039f-2b81-48c8-bceb-b6a9686b1be4 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1273136
May 31 16:26:09.303197 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91764) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:26:09.312815 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] Sync routers for ids ['9e698298-b838-4dbb-939c-c84fb0148003'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:26:09.324527 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] Routers {'9e698298-b838-4dbb-939c-c84fb0148003'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:26:09.325659 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f14262c3970>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:26:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['9e698298-b838-4dbb-939c-c84fb0148003'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:26:09.330738 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] Notify callbacks [] for router, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:09.331967 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-38e36f63-76b1-448e-83b8-610a0f5fc344 admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201  len: 919 time: 3.8038239
May 31 16:26:09.334928 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36492) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:09.614611 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] Set router 9e698298-b838-4dbb-939c-c84fb0148003 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:26:09.914662 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f14262c3970>, [{'id': '9e698298-b838-4dbb-939c-c84fb0148003', 'name': 'tempest-TestShelveInstance-844578684-router', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:05Z', 'updated_at': '2021-05-31T16:26:08Z', 'revision_number': 3, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'gw_port': {'id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:06:07', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_gateway', 'standard_attr_id': 550, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:07Z', 'updated_at': '2021-05-31T16:26:07Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:26:09.918819 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] Checking router: 9e698298-b838-4dbb-939c-c84fb0148003 for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:26:09.919176 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] Updating router 9e698298-b838-4dbb-939c-c84fb0148003 port dc058e78-0721-4760-9e77-06b3f85979b7 binding host dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 31 16:26:09.979643 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:10.149367 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:10.343797 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 8bb259a5-2a36-4eb3-9fe6-00460cc552fe up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:26:10.380603 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] Notify callbacks [] for port, precommit_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:10.411430 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] Transition to ACTIVE for port object dc058e78-0721-4760-9e77-06b3f85979b7 will not be triggered until provisioned by entity L2. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:26:10.421739 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:10.427923 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-bc285dd9-24f3-47fb-8036-0bc2a4735c09 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:10.515693 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] Attempting to bind port dc058e78-0721-4760-9e77-06b3f85979b7 on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:26:10.515988 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] Attempting to bind port dc058e78-0721-4760-9e77-06b3f85979b7 by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:26:10.516362 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] Attempting to bind port dc058e78-0721-4760-9e77-06b3f85979b7 on network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:26:10.523335 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-395abea5-960c-43d6-86e8-c606dcc9dfa7 None None] Pushing event updated for resources: {'Port': ['ID=dc058e78-0721-4760-9e77-06b3f85979b7,revision_number=2']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:10.527887 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-395abea5-960c-43d6-86e8-c606dcc9dfa7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:10.528809 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 26, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:26:10.529185 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] Checking segment: {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91765) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:26:10.529634 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:10.530030 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] Bound using segment: {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:26:10.530522 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] Bound port: dc058e78-0721-4760-9e77-06b3f85979b7, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:26:10.530903 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:10.537094 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Allocated IP 172.20.0.1 (0e202b3d-d60d-481f-bf3a-e31943668c98/20f6caad-2e13-4108-af8f-f9c2336ccde2/7fc65e68-76ee-48bf-8bb1-c3e5453fb94c) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:26:10.580339 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 8bb259a5-2a36-4eb3-9fe6-00460cc552fe triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:26:10.580737 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:10.664023 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] For port dc058e78-0721-4760-9e77-06b3f85979b7, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91765) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:26:10.669469 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] For port dc058e78-0721-4760-9e77-06b3f85979b7, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=dc058e78-0721-4760-9e77-06b3f85979b7,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91765) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:26:10.676510 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:10.680637 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:10.691993 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:10.707647 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.provisioning_blocks [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Transition to ACTIVE for port object 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c will not be triggered until provisioned by entity DHCP. {{(pid=91764) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:26:10.734434 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:10.738919 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-cf8f1614-ad2e-4d95-98a3-c1b294d7ead3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:10.807575 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Network 0e202b3d-d60d-481f-bf3a-e31943668c98 is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:26:10.810431 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:26:10.814933 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:26:10.860713 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Pushing event updated for resources: {'Port': ['ID=7fc65e68-76ee-48bf-8bb1-c3e5453fb94c,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:10.860949 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] Routers {'9e698298-b838-4dbb-939c-c84fb0148003'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:26:10.862508 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f14262c3970>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:26:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['9e698298-b838-4dbb-939c-c84fb0148003'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:26:10.866101 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:10.882399 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-16627828'] for router_interface, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:10.915386 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-395abea5-960c-43d6-86e8-c606dcc9dfa7 None None] Pushing event updated for resources: {'Port': ['ID=dc058e78-0721-4760-9e77-06b3f85979b7,revision_number=3']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:10.928514 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-395abea5-960c-43d6-86e8-c606dcc9dfa7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.247s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:10.954505 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:11.071733 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] Set router 9e698298-b838-4dbb-939c-c84fb0148003 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:26:11.184624 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:11.262796 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2fcf3d2b-91c2-41d0-8839-e92e801ba2d2 None None] Provisioning for port 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:26:11.271130 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2fcf3d2b-91c2-41d0-8839-e92e801ba2d2 None None] Provisioning complete for port 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:26:11.271479 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2fcf3d2b-91c2-41d0-8839-e92e801ba2d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:11.352371 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2fcf3d2b-91c2-41d0-8839-e92e801ba2d2 None None] Port 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:26:11.427762 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f14262c3970>, [{'id': '9e698298-b838-4dbb-939c-c84fb0148003', 'name': 'tempest-TestShelveInstance-844578684-router', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:05Z', 'updated_at': '2021-05-31T16:26:08Z', 'revision_number': 3, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'gw_port': {'id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:06:07', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_gateway', 'standard_attr_id': 550, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:07Z', 'updated_at': '2021-05-31T16:26:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:26:11.432315 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfc01cd4-e1cb-468f-ae34-b17ed084bc3e None None] The sync data for ids ['9e698298-b838-4dbb-939c-c84fb0148003'] in dv-cinder-793814-1-iscsi is: [{'id': '9e698298-b838-4dbb-939c-c84fb0148003', 'name': 'tempest-TestShelveInstance-844578684-router', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:05Z', 'updated_at': '2021-05-31T16:26:08Z', 'revision_number': 3, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'gw_port': {'id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:06:07', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_gateway', 'standard_attr_id': 550, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:07Z', 'updated_at': '2021-05-31T16:26:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:26:11.432604 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:11.438205 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:11.464708 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-62f9bed6-28a6-4d0c-9ce7-74d5d2c6473a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:11.550365 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Pushing event updated for resources: {'Port': ['ID=7fc65e68-76ee-48bf-8bb1-c3e5453fb94c,revision_number=2']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:11.558426 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:11.561776 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-16310860', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-16627929'] for router_interface, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:11.737509 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Network 0e202b3d-d60d-481f-bf3a-e31943668c98 is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:26:11.738749 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:26:11.967325 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Router 9e698298-b838-4dbb-939c-c84fb0148003 has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91764) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:26:11.990326 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-3ce2ed09-000d-4e25-8469-9870ae1121e7 None None] Provisioning complete for port 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:26:11.990918 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-3ce2ed09-000d-4e25-8469-9870ae1121e7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:12.057768 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-3ce2ed09-000d-4e25-8469-9870ae1121e7 None None] Port 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:26:12.316862 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91764) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:26:12.326621 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] 10.222.0.43 "PUT /v2.0/routers/9e698298-b838-4dbb-939c-c84fb0148003/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.9902134
May 31 16:26:12.378316 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device dc058e78-0721-4760-9e77-06b3f85979b7 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:26:12.452142 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port dc058e78-0721-4760-9e77-06b3f85979b7 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:26:12.458633 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port dc058e78-0721-4760-9e77-06b3f85979b7 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:26:12.459086 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:12.588121 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:12.610577 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port dc058e78-0721-4760-9e77-06b3f85979b7, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=dc058e78-0721-4760-9e77-06b3f85979b7,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:26:12.616008 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:12.619205 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-395abea5-960c-43d6-86e8-c606dcc9dfa7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:12.694813 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=dc058e78-0721-4760-9e77-06b3f85979b7,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:12.698414 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:13.015858 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 36518) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:13.022459 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-337520229-network', 'tenant_id': 'aaf741cd215644308245542578883a8a'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:26:13.027239 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:26:13.031175 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Usage tracker for resource:network and tenant:aaf741cd215644308245542578883a8a is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:26:13.034469 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:26:13.040989 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:26:13.057412 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Made reservation on behalf of aaf741cd215644308245542578883a8a for: {'network': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:26:13.059784 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-639279'] for network, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:13.073679 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:13.089261 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:26:13.093117 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Usage tracker for resource:security_group_rule and tenant:aaf741cd215644308245542578883a8a is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:26:13.096284 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:26:13.106183 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:26:13.128722 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] Sync routers for ids ['9e698298-b838-4dbb-939c-c84fb0148003'] in dv-cinder-793814-1-iscsi {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:26:13.139831 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] Routers {'9e698298-b838-4dbb-939c-c84fb0148003'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:26:13.140554 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1427063100>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:26:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['9e698298-b838-4dbb-939c-c84fb0148003'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:26:13.202500 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:13.207448 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:13.212222 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-87c276b6-8eb3-44ac-9cb1-8d60ba0f3ef1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:13.239691 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 832}  {{(pid=91763) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 31 16:26:13.254581 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=44f20ef9-5785-4c7b-aba1-676892713d2e,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:13.257449 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:13.257864 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.segments_db [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Added segment 55db7c87-2a89-44db-9f17-28d7a4f933d2 of type vlan for network b51eb33b-7c79-46ba-9423-a0ce34433ebb
May 31 16:26:13.259172 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:13.289357 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732784079930'] for network, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:13.322274 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366'] for network, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:13.323836 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:13.324525 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:13.330851 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:13.331989 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] Set router 9e698298-b838-4dbb-939c-c84fb0148003 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:26:13.431050 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 0.4139178
May 31 16:26:13.434136 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36522) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:13.434743 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Pushing event updated for resources: {'Network': ['ID=b51eb33b-7c79-46ba-9423-a0ce34433ebb,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:13.437256 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:13.446876 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Network b51eb33b-7c79-46ba-9423-a0ce34433ebb details requested by agent ovs-agent-dv-cinder-793814-1-iscsi with host dv-cinder-793814-1-iscsi {{(pid=91765) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 31 16:26:13.449178 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-173640e0-499b-4b83-9952-a8d8b5099489 admin admin] Request body: {'subnet': {'network_id': 'b51eb33b-7c79-46ba-9423-a0ce34433ebb', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-337520229-subnet', 'tenant_id': 'aaf741cd215644308245542578883a8a', 'ip_version': 4}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:26:13.454422 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-173640e0-499b-4b83-9952-a8d8b5099489 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:26:13.459467 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-173640e0-499b-4b83-9952-a8d8b5099489 admin admin] Usage tracker for resource:subnet and tenant:aaf741cd215644308245542578883a8a is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:26:13.462879 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-173640e0-499b-4b83-9952-a8d8b5099489 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:26:13.470051 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-173640e0-499b-4b83-9952-a8d8b5099489 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:26:13.484230 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-173640e0-499b-4b83-9952-a8d8b5099489 admin admin] Made reservation on behalf of aaf741cd215644308245542578883a8a for: {'subnet': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:26:13.489451 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-173640e0-499b-4b83-9952-a8d8b5099489 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14793668'] for subnet, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:13.665306 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1427063100>, [{'id': '9e698298-b838-4dbb-939c-c84fb0148003', 'name': 'tempest-TestShelveInstance-844578684-router', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:05Z', 'updated_at': '2021-05-31T16:26:11Z', 'revision_number': 4, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'gw_port': {'id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:06:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_gateway', 'standard_attr_id': 550, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:07Z', 'updated_at': '2021-05-31T16:26:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '7fc65e68-76ee-48bf-8bb1-c3e5453fb94c', 'name': '', 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'mac_address': 'fa:16:3e:c5:53:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_interface', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '20f6caad-2e13-4108-af8f-f9c2336ccde2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:10Z', 'updated_at': '2021-05-31T16:26:11Z', 'revision_number': 2, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'subnets': [{'id': '20f6caad-2e13-4108-af8f-f9c2336ccde2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:26:13.669320 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] Checking router: 9e698298-b838-4dbb-939c-c84fb0148003 for host: dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:26:13.669711 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] Updating router 9e698298-b838-4dbb-939c-c84fb0148003 port 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c binding host dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 31 16:26:13.726945 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:13.929614 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-173640e0-499b-4b83-9952-a8d8b5099489 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-14907233', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14793682'] for subnet, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:13.933688 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:14.099220 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-173640e0-499b-4b83-9952-a8d8b5099489 admin admin] Pushing event updated for resources: {'Subnet': ['ID=38eb0166-07db-4a38-bf20-2ae69f7dbb32,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:14.107071 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-173640e0-499b-4b83-9952-a8d8b5099489 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:14.124329 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-173640e0-499b-4b83-9952-a8d8b5099489 admin admin] Checking segment: {'id': '55db7c87-2a89-44db-9f17-28d7a4f933d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': 'b51eb33b-7c79-46ba-9423-a0ce34433ebb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:26:14.125110 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-173640e0-499b-4b83-9952-a8d8b5099489 admin admin] Network hostable DHCP agents. Network: b51eb33b-7c79-46ba-9423-a0ce34433ebb, hostable agents: ['5c9859e8-5965-4c86-8b2b-8fab235cbf66'], hosted agents: [] {{(pid=91764) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 31 16:26:14.150829 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] Notify callbacks [] for port, precommit_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:14.163929 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.provisioning_blocks [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] Transition to ACTIVE for port object 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c will not be triggered until provisioned by entity L2. {{(pid=91766) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:26:14.165464 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0eff1d94-9892-4fbd-a9b3-5284b49b5b1c req-e49daf55-99ae-4667-ac1d-b6fc19a57313 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.2012932
May 31 16:26:14.172121 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:14.174009 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-173640e0-499b-4b83-9952-a8d8b5099489 admin admin] Network b51eb33b-7c79-46ba-9423-a0ce34433ebb is scheduled to be hosted by DHCP agent 5c9859e8-5965-4c86-8b2b-8fab235cbf66 with binding_index 1 {{(pid=91764) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 31 16:26:14.182835 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-e422f006-9a4f-411e-bb59-1fac6bd18879 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:14.185585 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-173640e0-499b-4b83-9952-a8d8b5099489 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793814-1-iscsi, b51eb33b-7c79-46ba-9423-a0ce34433ebb) {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:26:14.198416 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fad98fdb-4aea-43e5-820f-0c6f9c32ef30 None None] Network b51eb33b-7c79-46ba-9423-a0ce34433ebb requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:26:14.235642 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-173640e0-499b-4b83-9952-a8d8b5099489 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:14.236802 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-173640e0-499b-4b83-9952-a8d8b5099489 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:14.249780 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be824183-0af9-4ea8-9412-13aabfbb1a76 None None] Pushing event updated for resources: {'Port': ['ID=7fc65e68-76ee-48bf-8bb1-c3e5453fb94c,revision_number=3']} {{(pid=91766) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:14.285385 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-173640e0-499b-4b83-9952-a8d8b5099489 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 844 time: 0.8473647
May 31 16:26:14.285622 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36528) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:14.291484 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-337520229-router', 'tenant_id': 'aaf741cd215644308245542578883a8a', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:26:14.296088 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:26:14.300982 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Usage tracker for resource:router and tenant:aaf741cd215644308245542578883a8a is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:26:14.304707 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:26:14.310590 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:26:14.327127 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eff1d94-9892-4fbd-a9b3-5284b49b5b1c req-c2380a63-c88e-45b4-92d3-aeaa3052baf6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:14.329130 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0eff1d94-9892-4fbd-a9b3-5284b49b5b1c req-c2380a63-c88e-45b4-92d3-aeaa3052baf6 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=a56002dfed61485aa4d9e237932e1abf&device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 1098 time: 0.1357913
May 31 16:26:14.330768 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-16623804', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-697'] for router, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:14.331874 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-16618684', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-16621667', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-16430734', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-672'] for router, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:14.351105 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:14.375288 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be824183-0af9-4ea8-9412-13aabfbb1a76 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:14.378613 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be824183-0af9-4ea8-9412-13aabfbb1a76 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:14.379142 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be824183-0af9-4ea8-9412-13aabfbb1a76 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:14.380318 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be824183-0af9-4ea8-9412-13aabfbb1a76 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:14.381772 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be824183-0af9-4ea8-9412-13aabfbb1a76 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:14.383592 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be824183-0af9-4ea8-9412-13aabfbb1a76 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:14.384309 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be824183-0af9-4ea8-9412-13aabfbb1a76 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:14.385020 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be824183-0af9-4ea8-9412-13aabfbb1a76 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:14.385725 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be824183-0af9-4ea8-9412-13aabfbb1a76 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:14.386256 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be824183-0af9-4ea8-9412-13aabfbb1a76 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:14.386804 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be824183-0af9-4ea8-9412-13aabfbb1a76 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:14.387339 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be824183-0af9-4ea8-9412-13aabfbb1a76 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91766) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:14.400215 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device dc058e78-0721-4760-9e77-06b3f85979b7 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:26:14.425120 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-be824183-0af9-4ea8-9412-13aabfbb1a76 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.242s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:14.456929 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] Attempting to bind port 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:26:14.457598 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] Attempting to bind port 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '1e70bee6-dfc7-4037-8e59-6c6e25de8649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 823, 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98'}] {{(pid=91766) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:26:14.458138 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] Attempting to bind port 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c on network 0e202b3d-d60d-481f-bf3a-e31943668c98 {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:26:14.464539 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 26, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:26:14.465320 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] Checking segment: {'id': '1e70bee6-dfc7-4037-8e59-6c6e25de8649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 823, 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91766) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:26:14.465923 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:14.467364 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] Bound using segment: {'id': '1e70bee6-dfc7-4037-8e59-6c6e25de8649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 823, 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98'} {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:26:14.468145 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] Bound port: 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1e70bee6-dfc7-4037-8e59-6c6e25de8649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 823, 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98'}}] {{(pid=91766) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:26:14.468699 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:14.574141 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp87ca72be-1027-56d4-a8d3-ba9dae998815-b51eb33b-7c79-46ba-9423-a0ce34433ebb', 'network_id': 'b51eb33b-7c79-46ba-9423-a0ce34433ebb', 'tenant_id': 'aaf741cd215644308245542578883a8a', 'fixed_ips': [{'subnet_id': '38eb0166-07db-4a38-bf20-2ae69f7dbb32'}]}} from dv-cinder-793814-1-iscsi. {{(pid=91765) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 31 16:26:14.575144 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:14.575770 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.db [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] For port 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91766) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:26:14.579267 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.db [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] For port 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=7fc65e68-76ee-48bf-8bb1-c3e5453fb94c,segment=NetworkSegment(1e70bee6-dfc7-4037-8e59-6c6e25de8649),segment_id=1e70bee6-dfc7-4037-8e59-6c6e25de8649)] {{(pid=91766) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:26:14.584126 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:14.594769 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port dc058e78-0721-4760-9e77-06b3f85979b7 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:26:14.595155 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:14.596439 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:14.665104 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] Routers {'9e698298-b838-4dbb-939c-c84fb0148003'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:26:14.665763 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1427063100>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:26:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['9e698298-b838-4dbb-939c-c84fb0148003'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:26:14.708802 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eff1d94-9892-4fbd-a9b3-5284b49b5b1c req-303a6d8c-408b-468b-9232-2983c8461cdb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:14.711090 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0eff1d94-9892-4fbd-a9b3-5284b49b5b1c req-303a6d8c-408b-468b-9232-2983c8461cdb service neutron] 10.222.0.63 "GET /v2.0/networks?id=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 HTTP/1.1" status: 200  len: 911 time: 0.3584063
May 31 16:26:14.747226 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be824183-0af9-4ea8-9412-13aabfbb1a76 None None] Pushing event updated for resources: {'Port': ['ID=7fc65e68-76ee-48bf-8bb1-c3e5453fb94c,revision_number=4']} {{(pid=91766) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:14.759699 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-be824183-0af9-4ea8-9412-13aabfbb1a76 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:14.858729 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16621638', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16623758', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-722'] for router, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:14.889945 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] Set router 9e698298-b838-4dbb-939c-c84fb0148003 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:26:14.921743 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0eff1d94-9892-4fbd-a9b3-5284b49b5b1c req-9d1a4281-d114-4379-a591-57808ed387c9 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=cd88a910-8740-4a3f-aafb-41a504f611ee HTTP/1.1" status: 200  len: 1000 time: 0.2010593
May 31 16:26:14.931787 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.db_base_plugin_common [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Allocated IP 172.20.0.2 (b51eb33b-7c79-46ba-9423-a0ce34433ebb/38eb0166-07db-4a38-bf20-2ae69f7dbb32/842aa924-305c-498f-aa53-f51584f13c78) {{(pid=91765) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:26:15.054062 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eff1d94-9892-4fbd-a9b3-5284b49b5b1c req-9aa5c96b-d2a2-42cc-8040-43bb5fa7600d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:15.055482 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0eff1d94-9892-4fbd-a9b3-5284b49b5b1c req-9aa5c96b-d2a2-42cc-8040-43bb5fa7600d service neutron] 10.222.0.63 "GET /v2.0/subnets?id=6489943b-1236-4d7c-80a7-58ef5aedf09d HTTP/1.1" status: 200  len: 849 time: 0.0853844
May 31 16:26:15.173254 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Notify callbacks [] for port, precommit_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:15.185124 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Transition to ACTIVE for port object 842aa924-305c-498f-aa53-f51584f13c78 will not be triggered until provisioned by entity L2. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:26:15.208114 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Transition to ACTIVE for port object 842aa924-305c-498f-aa53-f51584f13c78 will not be triggered until provisioned by entity DHCP. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:26:15.214683 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898'] for port, after_create {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:15.218491 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:15.264934 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1427063100>, [{'id': '9e698298-b838-4dbb-939c-c84fb0148003', 'name': 'tempest-TestShelveInstance-844578684-router', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:05Z', 'updated_at': '2021-05-31T16:26:11Z', 'revision_number': 4, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'gw_port': {'id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:06:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_gateway', 'standard_attr_id': 550, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:07Z', 'updated_at': '2021-05-31T16:26:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '7fc65e68-76ee-48bf-8bb1-c3e5453fb94c', 'name': '', 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'mac_address': 'fa:16:3e:c5:53:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_interface', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '20f6caad-2e13-4108-af8f-f9c2336ccde2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:10Z', 'updated_at': '2021-05-31T16:26:14Z', 'revision_number': 4, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'subnets': [{'id': '20f6caad-2e13-4108-af8f-f9c2336ccde2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:26:15.270090 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7696ab46-7ca9-41a8-820d-8ef24a04f49b None None] The sync data for ids ['9e698298-b838-4dbb-939c-c84fb0148003'] in dv-cinder-793814-1-iscsi is: [{'id': '9e698298-b838-4dbb-939c-c84fb0148003', 'name': 'tempest-TestShelveInstance-844578684-router', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:05Z', 'updated_at': '2021-05-31T16:26:11Z', 'revision_number': 4, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'gw_port': {'id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:06:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_gateway', 'standard_attr_id': 550, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:07Z', 'updated_at': '2021-05-31T16:26:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '7fc65e68-76ee-48bf-8bb1-c3e5453fb94c', 'name': '', 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'mac_address': 'fa:16:3e:c5:53:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_interface', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '20f6caad-2e13-4108-af8f-f9c2336ccde2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:10Z', 'updated_at': '2021-05-31T16:26:14Z', 'revision_number': 4, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'subnets': [{'id': '20f6caad-2e13-4108-af8f-f9c2336ccde2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:26:15.291468 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Network b51eb33b-7c79-46ba-9423-a0ce34433ebb is already hosted by enough agents. {{(pid=91765) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:26:15.295322 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.scheduler.base_scheduler [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Resources bound (agent type, host, resource id):  {{(pid=91765) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:26:15.299990 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Received port after_create {{(pid=91765) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:26:15.346176 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Pushing event updated for resources: {'Port': ['ID=842aa924-305c-498f-aa53-f51584f13c78,revision_number=1']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:15.355126 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:15.421240 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Attempting to bind port 842aa924-305c-498f-aa53-f51584f13c78 on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:26:15.421649 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Attempting to bind port 842aa924-305c-498f-aa53-f51584f13c78 by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '55db7c87-2a89-44db-9f17-28d7a4f933d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': 'b51eb33b-7c79-46ba-9423-a0ce34433ebb'}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:26:15.422019 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Attempting to bind port 842aa924-305c-498f-aa53-f51584f13c78 on network b51eb33b-7c79-46ba-9423-a0ce34433ebb {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:26:15.427998 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 26, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:26:15.428379 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Checking segment: {'id': '55db7c87-2a89-44db-9f17-28d7a4f933d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': 'b51eb33b-7c79-46ba-9423-a0ce34433ebb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91765) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:26:15.428789 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:15.429184 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Bound using segment: {'id': '55db7c87-2a89-44db-9f17-28d7a4f933d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': 'b51eb33b-7c79-46ba-9423-a0ce34433ebb'} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:26:15.429702 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Bound port: 842aa924-305c-498f-aa53-f51584f13c78, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '55db7c87-2a89-44db-9f17-28d7a4f933d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': 'b51eb33b-7c79-46ba-9423-a0ce34433ebb'}}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:26:15.430082 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:15.463184 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eff1d94-9892-4fbd-a9b3-5284b49b5b1c req-666b3781-4275-4b10-99e2-6fd233d1f9f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:15.464670 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0eff1d94-9892-4fbd-a9b3-5284b49b5b1c req-666b3781-4275-4b10-99e2-6fd233d1f9f8 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.4008520
May 31 16:26:15.532345 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] For port 842aa924-305c-498f-aa53-f51584f13c78, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91765) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:26:15.536552 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] For port 842aa924-305c-498f-aa53-f51584f13c78, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=842aa924-305c-498f-aa53-f51584f13c78,segment=NetworkSegment(55db7c87-2a89-44db-9f17-28d7a4f933d2),segment_id=55db7c87-2a89-44db-9f17-28d7a4f933d2)] {{(pid=91765) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:26:15.541117 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:15.544985 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:15.566861 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:15.605608 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:15.621970 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Pushing event updated for resources: {'Port': ['ID=842aa924-305c-498f-aa53-f51584f13c78,revision_number=2']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:15.627471 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:15.712565 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0eff1d94-9892-4fbd-a9b3-5284b49b5b1c req-6a7898e9-3c1d-4b41-832a-2a515645db0f service neutron] 10.222.0.63 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2375898
May 31 16:26:15.882890 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Allocated IP 172.27.0.158 (00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c/96709d85-d0fe-4cf8-b232-eaf6b143ebe6/6edd72e2-8a92-4c90-8270-1312d8c8f983) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:26:15.953414 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0eff1d94-9892-4fbd-a9b3-5284b49b5b1c req-5e57450a-501d-46e5-b4b9-bde9e1af0035 service neutron] 10.222.0.63 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2317166
May 31 16:26:16.083480 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:16.119956 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:16.124085 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:16.194665 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:26:16.197610 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:26:16.202049 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:26:16.228306 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Pushing event updated for resources: {'Port': ['ID=6edd72e2-8a92-4c90-8270-1312d8c8f983,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:16.233396 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:16.422400 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:26:16.520459 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:26:16.530038 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:26:16.531176 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:16.679825 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:16.695257 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:16.720076 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a74235d1-1031-441f-8ddf-998dfe839534 None None] Network b51eb33b-7c79-46ba-9423-a0ce34433ebb requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:26:16.790780 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=7fc65e68-76ee-48bf-8bb1-c3e5453fb94c,segment=NetworkSegment(1e70bee6-dfc7-4037-8e59-6c6e25de8649),segment_id=1e70bee6-dfc7-4037-8e59-6c6e25de8649)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:26:16.811807 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:16.812672 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 842aa924-305c-498f-aa53-f51584f13c78 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:26:16.844202 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-092e63fe-23a8-42ec-86aa-3d7d318e2477 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:16.943362 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-c69afd42-fe77-4074-b05f-1e1bc27e9350 None None] Provisioning for port 842aa924-305c-498f-aa53-f51584f13c78 completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:26:17.014630 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=7fc65e68-76ee-48bf-8bb1-c3e5453fb94c,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:17.022865 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:17.041643 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port 842aa924-305c-498f-aa53-f51584f13c78 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:26:17.072918 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 842aa924-305c-498f-aa53-f51584f13c78 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:26:17.073305 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:17.143504 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-16623797', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16621573'] for router, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:17.226471 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:17.262331 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port 842aa924-305c-498f-aa53-f51584f13c78, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=842aa924-305c-498f-aa53-f51584f13c78,segment=NetworkSegment(55db7c87-2a89-44db-9f17-28d7a4f933d2),segment_id=55db7c87-2a89-44db-9f17-28d7a4f933d2)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:26:17.266658 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:17.273724 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:17.352646 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=842aa924-305c-498f-aa53-f51584f13c78,revision_number=3']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:17.362999 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:17.366952 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Router a9a6ab5f-4296-4103-9658-5468573f9ddb is scheduled to L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e with binding_index 1 {{(pid=91764) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 31 16:26:17.494647 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-4091cb73-e93b-4114-aa4b-b6c03c6c244c None None] Provisioning complete for port 842aa924-305c-498f-aa53-f51584f13c78 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:26:17.495031 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-4091cb73-e93b-4114-aa4b-b6c03c6c244c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:17.562648 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91764) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:26:17.587165 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] Notify callbacks [] for router, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:17.591570 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-38f89ffc-ff56-4ac9-9432-28d9877e3939 admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201  len: 920 time: 3.3021472
May 31 16:26:17.591570 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36542) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:17.600644 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] Sync routers for ids ['a9a6ab5f-4296-4103-9658-5468573f9ddb'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:26:17.665926 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] Routers {'a9a6ab5f-4296-4103-9658-5468573f9ddb'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:26:17.666568 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1427a5aa30>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:26:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['a9a6ab5f-4296-4103-9658-5468573f9ddb'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:26:17.871101 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] Set router a9a6ab5f-4296-4103-9658-5468573f9ddb gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:26:18.191220 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1427a5aa30>, [{'id': 'a9a6ab5f-4296-4103-9658-5468573f9ddb', 'name': 'tempest-TestShelveInstance-337520229-router', 'tenant_id': 'aaf741cd215644308245542578883a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.158'}], 'enable_snat': True}, 'gw_port_id': '6edd72e2-8a92-4c90-8270-1312d8c8f983', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:14Z', 'updated_at': '2021-05-31T16:26:16Z', 'revision_number': 3, 'project_id': 'aaf741cd215644308245542578883a8a', 'gw_port': {'id': '6edd72e2-8a92-4c90-8270-1312d8c8f983', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:8a:59:1e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a9a6ab5f-4296-4103-9658-5468573f9ddb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 562, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:15Z', 'updated_at': '2021-05-31T16:26:15Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:26:18.195747 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] Checking router: a9a6ab5f-4296-4103-9658-5468573f9ddb for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:26:18.196179 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] Updating router a9a6ab5f-4296-4103-9658-5468573f9ddb port 6edd72e2-8a92-4c90-8270-1312d8c8f983 binding host dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 31 16:26:18.252773 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:18.364192 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:26:18.500689 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:18.539610 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:26:18.539987 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:18.713135 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Allocated IP 172.20.0.1 (b51eb33b-7c79-46ba-9423-a0ce34433ebb/38eb0166-07db-4a38-bf20-2ae69f7dbb32/58810335-9a49-4d92-a985-50523399ef7d) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:26:18.745256 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 842aa924-305c-498f-aa53-f51584f13c78 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:26:18.775990 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] Notify callbacks [] for port, precommit_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:18.804644 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] Transition to ACTIVE for port object 6edd72e2-8a92-4c90-8270-1312d8c8f983 will not be triggered until provisioned by entity L2. {{(pid=91765) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:26:18.813931 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:18.820175 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:18.867188 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:18.883271 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.provisioning_blocks [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Transition to ACTIVE for port object 58810335-9a49-4d92-a985-50523399ef7d will not be triggered until provisioned by entity DHCP. {{(pid=91764) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:26:18.903572 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] Attempting to bind port 6edd72e2-8a92-4c90-8270-1312d8c8f983 on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:26:18.904245 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] Attempting to bind port 6edd72e2-8a92-4c90-8270-1312d8c8f983 by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:26:18.904387 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] Attempting to bind port 6edd72e2-8a92-4c90-8270-1312d8c8f983 on network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:26:18.913608 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:18.915395 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 842aa924-305c-498f-aa53-f51584f13c78 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:26:18.915777 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:18.918273 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-3ef5e87d-e28c-4950-bc0a-229c584138b3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:18.938725 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f728e85-a429-4786-a452-096b7c515647 None None] Pushing event updated for resources: {'Port': ['ID=6edd72e2-8a92-4c90-8270-1312d8c8f983,revision_number=2']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:18.946511 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 26, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:26:18.946637 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] Checking segment: {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91765) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:26:18.946994 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:18.947382 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] Bound using segment: {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'} {{(pid=91765) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:26:18.947868 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.managers [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] Bound port: 6edd72e2-8a92-4c90-8270-1312d8c8f983, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2373ca36-2a20-452a-927f-d77f06588c5e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}}] {{(pid=91765) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:26:18.948234 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:18.977198 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-9f728e85-a429-4786-a452-096b7c515647 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:18.979275 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Network b51eb33b-7c79-46ba-9423-a0ce34433ebb is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:26:18.983297 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:26:18.992614 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:26:19.045916 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Pushing event updated for resources: {'Port': ['ID=58810335-9a49-4d92-a985-50523399ef7d,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:19.069150 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:19.069700 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:19.070075 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:19.070439 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:19.070797 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:19.071155 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:19.071510 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:19.071864 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:19.072218 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:19.072563 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:19.072913 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:19.073313 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:19.075397 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] For port 6edd72e2-8a92-4c90-8270-1312d8c8f983, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91765) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:26:19.077967 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:19.090070 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-16627828'] for router_interface, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:19.103573 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] For port 6edd72e2-8a92-4c90-8270-1312d8c8f983, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=6edd72e2-8a92-4c90-8270-1312d8c8f983,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91765) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:26:19.111691 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:19.117697 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-8f7eb4b3-9633-4167-ae8a-6435b1dbbc08 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:19.200692 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] Routers {'a9a6ab5f-4296-4103-9658-5468573f9ddb'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:26:19.201324 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1427a5aa30>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:26:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['a9a6ab5f-4296-4103-9658-5468573f9ddb'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:26:19.234969 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:19.303039 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f728e85-a429-4786-a452-096b7c515647 None None] Pushing event updated for resources: {'Port': ['ID=6edd72e2-8a92-4c90-8270-1312d8c8f983,revision_number=3']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:19.315803 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-9f728e85-a429-4786-a452-096b7c515647 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:19.340460 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2e57cc76-c4e7-4d29-a2ba-5424c6a5c9c8 None None] Provisioning for port 58810335-9a49-4d92-a985-50523399ef7d completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:26:19.350417 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2e57cc76-c4e7-4d29-a2ba-5424c6a5c9c8 None None] Provisioning complete for port 58810335-9a49-4d92-a985-50523399ef7d triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:26:19.350764 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2e57cc76-c4e7-4d29-a2ba-5424c6a5c9c8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:19.478913 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:19.484179 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:19.488812 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2e57cc76-c4e7-4d29-a2ba-5424c6a5c9c8 None None] Port 58810335-9a49-4d92-a985-50523399ef7d cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:26:19.505503 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] Set router a9a6ab5f-4296-4103-9658-5468573f9ddb gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:26:19.513002 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-2c9f4e53-fc85-4f83-9079-071f8403eb25 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:19.596878 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Pushing event updated for resources: {'Port': ['ID=58810335-9a49-4d92-a985-50523399ef7d,revision_number=2']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:19.599608 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:19.600730 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-16310860', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-16627929'] for router_interface, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:19.715248 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:19.741628 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Network b51eb33b-7c79-46ba-9423-a0ce34433ebb is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:26:19.742836 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:26:19.847795 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1427a5aa30>, [{'id': 'a9a6ab5f-4296-4103-9658-5468573f9ddb', 'name': 'tempest-TestShelveInstance-337520229-router', 'tenant_id': 'aaf741cd215644308245542578883a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.158'}], 'enable_snat': True}, 'gw_port_id': '6edd72e2-8a92-4c90-8270-1312d8c8f983', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:14Z', 'updated_at': '2021-05-31T16:26:19Z', 'revision_number': 4, 'project_id': 'aaf741cd215644308245542578883a8a', 'gw_port': {'id': '6edd72e2-8a92-4c90-8270-1312d8c8f983', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:8a:59:1e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a9a6ab5f-4296-4103-9658-5468573f9ddb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 562, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:15Z', 'updated_at': '2021-05-31T16:26:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '58810335-9a49-4d92-a985-50523399ef7d', 'name': '', 'network_id': 'b51eb33b-7c79-46ba-9423-a0ce34433ebb', 'tenant_id': 'aaf741cd215644308245542578883a8a', 'mac_address': 'fa:16:3e:8f:2e:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a9a6ab5f-4296-4103-9658-5468573f9ddb', 'device_owner': 'network:router_interface', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': '38eb0166-07db-4a38-bf20-2ae69f7dbb32', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:18Z', 'updated_at': '2021-05-31T16:26:18Z', 'revision_number': 1, 'project_id': 'aaf741cd215644308245542578883a8a', 'subnets': [{'id': '38eb0166-07db-4a38-bf20-2ae69f7dbb32', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:26:19.849244 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f85eb763-ac30-494c-838d-ec1c87ea44ba None None] The sync data for ids ['a9a6ab5f-4296-4103-9658-5468573f9ddb'] in dv-cinder-793814-1-iscsi is: [{'id': 'a9a6ab5f-4296-4103-9658-5468573f9ddb', 'name': 'tempest-TestShelveInstance-337520229-router', 'tenant_id': 'aaf741cd215644308245542578883a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.158'}], 'enable_snat': True}, 'gw_port_id': '6edd72e2-8a92-4c90-8270-1312d8c8f983', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:14Z', 'updated_at': '2021-05-31T16:26:19Z', 'revision_number': 4, 'project_id': 'aaf741cd215644308245542578883a8a', 'gw_port': {'id': '6edd72e2-8a92-4c90-8270-1312d8c8f983', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:8a:59:1e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a9a6ab5f-4296-4103-9658-5468573f9ddb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 562, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:15Z', 'updated_at': '2021-05-31T16:26:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '58810335-9a49-4d92-a985-50523399ef7d', 'name': '', 'network_id': 'b51eb33b-7c79-46ba-9423-a0ce34433ebb', 'tenant_id': 'aaf741cd215644308245542578883a8a', 'mac_address': 'fa:16:3e:8f:2e:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a9a6ab5f-4296-4103-9658-5468573f9ddb', 'device_owner': 'network:router_interface', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': '38eb0166-07db-4a38-bf20-2ae69f7dbb32', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:18Z', 'updated_at': '2021-05-31T16:26:18Z', 'revision_number': 1, 'project_id': 'aaf741cd215644308245542578883a8a', 'subnets': [{'id': '38eb0166-07db-4a38-bf20-2ae69f7dbb32', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:26:19.966155 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Router a9a6ab5f-4296-4103-9658-5468573f9ddb has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91764) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:26:20.019847 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-9eaede19-1bef-4135-858b-26df12e3bb64 None None] Provisioning complete for port 58810335-9a49-4d92-a985-50523399ef7d triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:26:20.020318 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-9eaede19-1bef-4135-858b-26df12e3bb64 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:20.132028 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-9eaede19-1bef-4135-858b-26df12e3bb64 None None] Port 58810335-9a49-4d92-a985-50523399ef7d cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:26:20.185471 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91764) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:26:20.198546 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] 10.222.0.43 "PUT /v2.0/routers/a9a6ab5f-4296-4103-9658-5468573f9ddb/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6049793
May 31 16:26:20.715410 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 36574) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:20.721692 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-fbbf6c4f-32cf-48e8-b5d7-b6dffb34f534 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-529917592', 'description': 'tempest-secgroup-smoke-529917592 description', 'project_id': 'ff0bbba58394409987a388bb38868b4e'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:26:20.728273 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-fbbf6c4f-32cf-48e8-b5d7-b6dffb34f534 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:26:20.732223 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-fbbf6c4f-32cf-48e8-b5d7-b6dffb34f534 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Usage tracker for resource:security_group and tenant:ff0bbba58394409987a388bb38868b4e is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:26:20.735194 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-fbbf6c4f-32cf-48e8-b5d7-b6dffb34f534 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:26:20.742808 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-fbbf6c4f-32cf-48e8-b5d7-b6dffb34f534 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:26:20.753593 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fbbf6c4f-32cf-48e8-b5d7-b6dffb34f534 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:20.764979 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa780fb2-9732-427b-8658-c77120a60b47 req-8c6b0afb-b73d-4cc3-a5b1-78b108b8deb8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:20.766476 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-aa780fb2-9732-427b-8658-c77120a60b47 req-8c6b0afb-b73d-4cc3-a5b1-78b108b8deb8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.1998136
May 31 16:26:20.773634 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-fbbf6c4f-32cf-48e8-b5d7-b6dffb34f534 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:26:20.777372 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-fbbf6c4f-32cf-48e8-b5d7-b6dffb34f534 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Usage tracker for resource:security_group_rule and tenant:ff0bbba58394409987a388bb38868b4e is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:26:20.780226 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-fbbf6c4f-32cf-48e8-b5d7-b6dffb34f534 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:26:20.786558 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-fbbf6c4f-32cf-48e8-b5d7-b6dffb34f534 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:26:20.813197 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-aa780fb2-9732-427b-8658-c77120a60b47 req-832f10f8-9479-4422-a359-33557a39584b tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0406826
May 31 16:26:20.860948 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fbbf6c4f-32cf-48e8-b5d7-b6dffb34f534 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:20.864813 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fbbf6c4f-32cf-48e8-b5d7-b6dffb34f534 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:20.869224 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-2b8cc7c2-5cca-441d-b8f3-4a1880ed1a95 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:20.916670 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbbf6c4f-32cf-48e8-b5d7-b6dffb34f534 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Pushing event updated for resources: {'SecurityGroup': ['ID=98f3ba1c-e634-454a-bd75-897eb9d73543,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:20.920383 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-fbbf6c4f-32cf-48e8-b5d7-b6dffb34f534 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:20.933082 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fbbf6c4f-32cf-48e8-b5d7-b6dffb34f534 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:20.934533 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-fbbf6c4f-32cf-48e8-b5d7-b6dffb34f534 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1792 time: 0.2180340
May 31 16:26:20.937715 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36578) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:20.943256 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-5f1619c9-18ef-4201-b261-bf39e60ac91a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Request body: {'security_group_rule': {'security_group_id': '98f3ba1c-e634-454a-bd75-897eb9d73543', 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:26:20.950954 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-5f1619c9-18ef-4201-b261-bf39e60ac91a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:26:20.955037 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-5f1619c9-18ef-4201-b261-bf39e60ac91a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Usage tracker for resource:security_group_rule and tenant:ff0bbba58394409987a388bb38868b4e is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:26:20.957940 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-5f1619c9-18ef-4201-b261-bf39e60ac91a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:26:20.964099 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-5f1619c9-18ef-4201-b261-bf39e60ac91a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:26:20.980206 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5f1619c9-18ef-4201-b261-bf39e60ac91a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.042431 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5f1619c9-18ef-4201-b261-bf39e60ac91a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.046257 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5f1619c9-18ef-4201-b261-bf39e60ac91a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.049021 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:21.071468 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f1619c9-18ef-4201-b261-bf39e60ac91a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=455bfeb1-10d0-43e6-9bcf-ccf264662f59,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:21.075965 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-5f1619c9-18ef-4201-b261-bf39e60ac91a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:21.081552 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5f1619c9-18ef-4201-b261-bf39e60ac91a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.082739 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-5f1619c9-18ef-4201-b261-bf39e60ac91a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1440899
May 31 16:26:21.085452 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36582) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:21.090750 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-e30bd88f-6166-4685-a83e-d2f5027f60a9 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Request body: {'security_group_rule': {'security_group_id': '98f3ba1c-e634-454a-bd75-897eb9d73543', 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:26:21.097110 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-e30bd88f-6166-4685-a83e-d2f5027f60a9 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:26:21.101130 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-e30bd88f-6166-4685-a83e-d2f5027f60a9 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Usage tracker for resource:security_group_rule and tenant:ff0bbba58394409987a388bb38868b4e is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:26:21.104649 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-e30bd88f-6166-4685-a83e-d2f5027f60a9 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:26:21.110506 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-e30bd88f-6166-4685-a83e-d2f5027f60a9 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:26:21.127517 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e30bd88f-6166-4685-a83e-d2f5027f60a9 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.193205 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e30bd88f-6166-4685-a83e-d2f5027f60a9 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.196677 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e30bd88f-6166-4685-a83e-d2f5027f60a9 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.204144 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-3da599b5-8b50-4a82-8973-7e54433bd5e8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:21.225674 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e30bd88f-6166-4685-a83e-d2f5027f60a9 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9f9949ce-e92d-47b6-86c2-66bb0e49c20c,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:21.227973 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-e30bd88f-6166-4685-a83e-d2f5027f60a9 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:21.232646 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e30bd88f-6166-4685-a83e-d2f5027f60a9 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.234055 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-e30bd88f-6166-4685-a83e-d2f5027f60a9 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.1476641
May 31 16:26:21.237282 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36586) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:21.242419 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-5df71de8-bb25-4d36-b66c-e2d205c316d5 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Request body: {'security_group_rule': {'security_group_id': '98f3ba1c-e634-454a-bd75-897eb9d73543', 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:26:21.248228 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-5df71de8-bb25-4d36-b66c-e2d205c316d5 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:26:21.252706 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-5df71de8-bb25-4d36-b66c-e2d205c316d5 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Usage tracker for resource:security_group_rule and tenant:ff0bbba58394409987a388bb38868b4e is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:26:21.255722 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-5df71de8-bb25-4d36-b66c-e2d205c316d5 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:26:21.261436 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-5df71de8-bb25-4d36-b66c-e2d205c316d5 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:26:21.277942 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5df71de8-bb25-4d36-b66c-e2d205c316d5 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.340244 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5df71de8-bb25-4d36-b66c-e2d205c316d5 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.343912 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5df71de8-bb25-4d36-b66c-e2d205c316d5 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.350722 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:21.369887 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5df71de8-bb25-4d36-b66c-e2d205c316d5 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=976a04b5-ef59-44b4-b5d9-61158df3ef55,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:21.372308 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-5df71de8-bb25-4d36-b66c-e2d205c316d5 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:21.379599 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-5df71de8-bb25-4d36-b66c-e2d205c316d5 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.380810 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-5df71de8-bb25-4d36-b66c-e2d205c316d5 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1425745
May 31 16:26:21.383414 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 36592) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:21.388403 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-dc946550-feea-48de-bada-339b25e3c751 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Request body: {'security_group_rule': {'security_group_id': '98f3ba1c-e634-454a-bd75-897eb9d73543', 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:26:21.394785 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-dc946550-feea-48de-bada-339b25e3c751 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:26:21.398721 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-dc946550-feea-48de-bada-339b25e3c751 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Usage tracker for resource:security_group_rule and tenant:ff0bbba58394409987a388bb38868b4e is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:26:21.401664 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-dc946550-feea-48de-bada-339b25e3c751 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:26:21.407344 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-dc946550-feea-48de-bada-339b25e3c751 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:26:21.424047 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-dc946550-feea-48de-bada-339b25e3c751 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.494908 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-dc946550-feea-48de-bada-339b25e3c751 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.498865 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-dc946550-feea-48de-bada-339b25e3c751 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.505662 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c400822a-5666-4056-b655-2b1b3600f981 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:21.524252 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc946550-feea-48de-bada-339b25e3c751 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b201d637-db82-41d5-b67f-f5866a5023af,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:21.526709 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-dc946550-feea-48de-bada-339b25e3c751 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:21.534361 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-dc946550-feea-48de-bada-339b25e3c751 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.535607 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-dc946550-feea-48de-bada-339b25e3c751 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.1512494
May 31 16:26:21.538413 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 36596) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:21.544603 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-1bde041c-92f8-4f8d-b62d-9c23cf567899 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Request body: {'security_group_rule': {'security_group_id': '98f3ba1c-e634-454a-bd75-897eb9d73543', 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:26:21.551009 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-1bde041c-92f8-4f8d-b62d-9c23cf567899 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:26:21.554841 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-1bde041c-92f8-4f8d-b62d-9c23cf567899 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Usage tracker for resource:security_group_rule and tenant:ff0bbba58394409987a388bb38868b4e is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:26:21.557893 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-1bde041c-92f8-4f8d-b62d-9c23cf567899 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:26:21.563734 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-1bde041c-92f8-4f8d-b62d-9c23cf567899 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:26:21.584490 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.securitygroups_db [None req-1bde041c-92f8-4f8d-b62d-9c23cf567899 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Project ff0bbba58394409987a388bb38868b4e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 31 16:26:21.590726 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1bde041c-92f8-4f8d-b62d-9c23cf567899 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.661458 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1bde041c-92f8-4f8d-b62d-9c23cf567899 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.665277 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1bde041c-92f8-4f8d-b62d-9c23cf567899 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.667385 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-925090f9-44f6-40f6-badc-0d902e031679 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:21.690159 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bde041c-92f8-4f8d-b62d-9c23cf567899 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5dfb1746-aaf7-42b4-9885-f1395abc1f87,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:21.692550 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-1bde041c-92f8-4f8d-b62d-9c23cf567899 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:21.699442 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1bde041c-92f8-4f8d-b62d-9c23cf567899 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.700603 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-1bde041c-92f8-4f8d-b62d-9c23cf567899 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.1608281
May 31 16:26:21.703327 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 36600) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:26:21.708619 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-ddaefa07-715f-421d-ac0d-ff3ba658f648 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Request body: {'security_group_rule': {'security_group_id': '98f3ba1c-e634-454a-bd75-897eb9d73543', 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:26:21.714954 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-ddaefa07-715f-421d-ac0d-ff3ba658f648 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:26:21.718607 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-ddaefa07-715f-421d-ac0d-ff3ba658f648 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Usage tracker for resource:security_group_rule and tenant:ff0bbba58394409987a388bb38868b4e is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:26:21.721814 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-ddaefa07-715f-421d-ac0d-ff3ba658f648 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:26:21.728395 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-ddaefa07-715f-421d-ac0d-ff3ba658f648 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:26:21.739284 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.securitygroups_db [None req-ddaefa07-715f-421d-ac0d-ff3ba658f648 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Project ff0bbba58394409987a388bb38868b4e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 31 16:26:21.745039 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ddaefa07-715f-421d-ac0d-ff3ba658f648 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.817706 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ddaefa07-715f-421d-ac0d-ff3ba658f648 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.821583 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ddaefa07-715f-421d-ac0d-ff3ba658f648 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.824184 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:21.847425 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddaefa07-715f-421d-ac0d-ff3ba658f648 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3692ca24-7335-48ef-a34c-ca3a22709371,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:21.849931 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-ddaefa07-715f-421d-ac0d-ff3ba658f648 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:21.861933 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ddaefa07-715f-421d-ac0d-ff3ba658f648 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:21.863122 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-ddaefa07-715f-421d-ac0d-ff3ba658f648 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.1587269
May 31 16:26:22.025731 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b90197ef-f92c-425c-a890-a46332395321 req-8b7bca57-2f95-43fc-bc0a-35f2fccc77c4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:22.027384 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b90197ef-f92c-425c-a890-a46332395321 req-8b7bca57-2f95-43fc-bc0a-35f2fccc77c4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.0965936
May 31 16:26:22.084020 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b90197ef-f92c-425c-a890-a46332395321 req-6dff1f64-3adc-4365-b76b-4803d0ec2523 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0497210
May 31 16:26:22.369313 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 6edd72e2-8a92-4c90-8270-1312d8c8f983 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:26:22.446826 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port 6edd72e2-8a92-4c90-8270-1312d8c8f983 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:26:22.452303 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 6edd72e2-8a92-4c90-8270-1312d8c8f983 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:26:22.452692 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:22.587031 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:22.612606 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port 6edd72e2-8a92-4c90-8270-1312d8c8f983, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=6edd72e2-8a92-4c90-8270-1312d8c8f983,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:26:22.618736 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:22.620896 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-596c0306-c563-4c98-a872-43435ad01140 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:22.692034 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=6edd72e2-8a92-4c90-8270-1312d8c8f983,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:22.695152 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:23.293347 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1de9b1c-cc43-4e99-95e6-d8346dfd29fb req-47f1249a-24fd-4edd-8975-4979df5b23a7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:23.294825 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a1de9b1c-cc43-4e99-95e6-d8346dfd29fb req-47f1249a-24fd-4edd-8975-4979df5b23a7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.0909302
May 31 16:26:23.332991 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] Sync routers for ids ['a9a6ab5f-4296-4103-9658-5468573f9ddb'] in dv-cinder-793814-1-iscsi {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:26:23.341657 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a1de9b1c-cc43-4e99-95e6-d8346dfd29fb req-329fef65-31f8-43a5-8694-394a142a2c30 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0407827
May 31 16:26:23.342046 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] Routers {'a9a6ab5f-4296-4103-9658-5468573f9ddb'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:26:23.342740 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1427063d30>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:26:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['a9a6ab5f-4296-4103-9658-5468573f9ddb'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:26:23.525109 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] Set router a9a6ab5f-4296-4103-9658-5468573f9ddb gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:26:23.870129 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1427063d30>, [{'id': 'a9a6ab5f-4296-4103-9658-5468573f9ddb', 'name': 'tempest-TestShelveInstance-337520229-router', 'tenant_id': 'aaf741cd215644308245542578883a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.158'}], 'enable_snat': True}, 'gw_port_id': '6edd72e2-8a92-4c90-8270-1312d8c8f983', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:14Z', 'updated_at': '2021-05-31T16:26:19Z', 'revision_number': 4, 'project_id': 'aaf741cd215644308245542578883a8a', 'gw_port': {'id': '6edd72e2-8a92-4c90-8270-1312d8c8f983', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:8a:59:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9a6ab5f-4296-4103-9658-5468573f9ddb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 562, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:15Z', 'updated_at': '2021-05-31T16:26:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '58810335-9a49-4d92-a985-50523399ef7d', 'name': '', 'network_id': 'b51eb33b-7c79-46ba-9423-a0ce34433ebb', 'tenant_id': 'aaf741cd215644308245542578883a8a', 'mac_address': 'fa:16:3e:8f:2e:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a9a6ab5f-4296-4103-9658-5468573f9ddb', 'device_owner': 'network:router_interface', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': '38eb0166-07db-4a38-bf20-2ae69f7dbb32', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:18Z', 'updated_at': '2021-05-31T16:26:19Z', 'revision_number': 2, 'project_id': 'aaf741cd215644308245542578883a8a', 'subnets': [{'id': '38eb0166-07db-4a38-bf20-2ae69f7dbb32', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:26:23.875301 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] Checking router: a9a6ab5f-4296-4103-9658-5468573f9ddb for host: dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:26:23.875769 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] Updating router a9a6ab5f-4296-4103-9658-5468573f9ddb port 58810335-9a49-4d92-a985-50523399ef7d binding host dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 31 16:26:23.930360 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:24.277688 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] Notify callbacks [] for port, precommit_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:24.289687 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.provisioning_blocks [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] Transition to ACTIVE for port object 58810335-9a49-4d92-a985-50523399ef7d will not be triggered until provisioned by entity L2. {{(pid=91766) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:26:24.297307 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:24.302081 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:24.347149 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 6edd72e2-8a92-4c90-8270-1312d8c8f983 up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:26:24.372706 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8098d566-50ee-4435-9eb5-61c24d2eb101 None None] Pushing event updated for resources: {'Port': ['ID=58810335-9a49-4d92-a985-50523399ef7d,revision_number=3']} {{(pid=91766) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:24.419268 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 6edd72e2-8a92-4c90-8270-1312d8c8f983 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:26:24.419752 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:24.534287 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-8098d566-50ee-4435-9eb5-61c24d2eb101 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.232s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:24.598055 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] Attempting to bind port 58810335-9a49-4d92-a985-50523399ef7d on host dv-cinder-793814-1-iscsi for vnic_type normal with profile  {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:26:24.598588 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] Attempting to bind port 58810335-9a49-4d92-a985-50523399ef7d by drivers openvswitch,hyperv on host dv-cinder-793814-1-iscsi at level 0 using segments [{'id': '55db7c87-2a89-44db-9f17-28d7a4f933d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': 'b51eb33b-7c79-46ba-9423-a0ce34433ebb'}] {{(pid=91766) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:26:24.599107 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] Attempting to bind port 58810335-9a49-4d92-a985-50523399ef7d on network b51eb33b-7c79-46ba-9423-a0ce34433ebb {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:26:24.607570 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] Checking agent: {'id': '06df7d67-fabe-41ae-852a-28718db7fb86', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793814-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 12, 8), 'started_at': datetime.datetime(2021, 5, 31, 16, 12, 38), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 26, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793814-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:26:24.607947 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] Checking segment: {'id': '55db7c87-2a89-44db-9f17-28d7a4f933d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': 'b51eb33b-7c79-46ba-9423-a0ce34433ebb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91766) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:26:24.608351 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:24.608740 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] Bound using segment: {'id': '55db7c87-2a89-44db-9f17-28d7a4f933d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': 'b51eb33b-7c79-46ba-9423-a0ce34433ebb'} {{(pid=91766) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:26:24.609216 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.managers [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] Bound port: 58810335-9a49-4d92-a985-50523399ef7d, host: dv-cinder-793814-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '55db7c87-2a89-44db-9f17-28d7a4f933d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': 'b51eb33b-7c79-46ba-9423-a0ce34433ebb'}}] {{(pid=91766) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:26:24.609612 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:24.612986 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26dd267-4641-4c9e-a422-918c36c2db3e req-74cdbb7e-7f34-496c-8ffc-5c33b2f89143 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:24.614470 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e26dd267-4641-4c9e-a422-918c36c2db3e req-74cdbb7e-7f34-496c-8ffc-5c33b2f89143 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.1340764
May 31 16:26:24.661316 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e26dd267-4641-4c9e-a422-918c36c2db3e req-248d31cd-63af-4fdc-8735-49b6ad4b2c99 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0411010
May 31 16:26:24.705778 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.db [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] For port 58810335-9a49-4d92-a985-50523399ef7d, host dv-cinder-793814-1-iscsi, cleared binding levels {{(pid=91766) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:26:24.708769 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.plugins.ml2.db [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] For port 58810335-9a49-4d92-a985-50523399ef7d, host dv-cinder-793814-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=58810335-9a49-4d92-a985-50523399ef7d,segment=NetworkSegment(55db7c87-2a89-44db-9f17-28d7a4f933d2),segment_id=55db7c87-2a89-44db-9f17-28d7a4f933d2)] {{(pid=91766) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:26:24.713265 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron_lib.callbacks.manager [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91766) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:24.717246 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-3d376f11-0bf2-4249-bf15-9e7aea789c45 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:24.799732 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8098d566-50ee-4435-9eb5-61c24d2eb101 None None] Pushing event updated for resources: {'Port': ['ID=58810335-9a49-4d92-a985-50523399ef7d,revision_number=4']} {{(pid=91766) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:24.803756 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG oslo_concurrency.lockutils [None req-8098d566-50ee-4435-9eb5-61c24d2eb101 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:24.804511 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] Routers {'a9a6ab5f-4296-4103-9658-5468573f9ddb'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:26:24.805315 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1427063d30>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:26:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['a9a6ab5f-4296-4103-9658-5468573f9ddb'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:26:25.006424 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] Set router a9a6ab5f-4296-4103-9658-5468573f9ddb gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:26:25.322579 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1427063d30>, [{'id': 'a9a6ab5f-4296-4103-9658-5468573f9ddb', 'name': 'tempest-TestShelveInstance-337520229-router', 'tenant_id': 'aaf741cd215644308245542578883a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.158'}], 'enable_snat': True}, 'gw_port_id': '6edd72e2-8a92-4c90-8270-1312d8c8f983', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:14Z', 'updated_at': '2021-05-31T16:26:19Z', 'revision_number': 4, 'project_id': 'aaf741cd215644308245542578883a8a', 'gw_port': {'id': '6edd72e2-8a92-4c90-8270-1312d8c8f983', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:8a:59:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9a6ab5f-4296-4103-9658-5468573f9ddb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 562, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:15Z', 'updated_at': '2021-05-31T16:26:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '58810335-9a49-4d92-a985-50523399ef7d', 'name': '', 'network_id': 'b51eb33b-7c79-46ba-9423-a0ce34433ebb', 'tenant_id': 'aaf741cd215644308245542578883a8a', 'mac_address': 'fa:16:3e:8f:2e:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a9a6ab5f-4296-4103-9658-5468573f9ddb', 'device_owner': 'network:router_interface', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': '38eb0166-07db-4a38-bf20-2ae69f7dbb32', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:18Z', 'updated_at': '2021-05-31T16:26:24Z', 'revision_number': 4, 'project_id': 'aaf741cd215644308245542578883a8a', 'subnets': [{'id': '38eb0166-07db-4a38-bf20-2ae69f7dbb32', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:26:25.326383 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdb3dab1-fcaa-43d7-b48d-3ef10b4f13fd None None] The sync data for ids ['a9a6ab5f-4296-4103-9658-5468573f9ddb'] in dv-cinder-793814-1-iscsi is: [{'id': 'a9a6ab5f-4296-4103-9658-5468573f9ddb', 'name': 'tempest-TestShelveInstance-337520229-router', 'tenant_id': 'aaf741cd215644308245542578883a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.158'}], 'enable_snat': True}, 'gw_port_id': '6edd72e2-8a92-4c90-8270-1312d8c8f983', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:14Z', 'updated_at': '2021-05-31T16:26:19Z', 'revision_number': 4, 'project_id': 'aaf741cd215644308245542578883a8a', 'gw_port': {'id': '6edd72e2-8a92-4c90-8270-1312d8c8f983', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:8a:59:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9a6ab5f-4296-4103-9658-5468573f9ddb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 562, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:15Z', 'updated_at': '2021-05-31T16:26:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '58810335-9a49-4d92-a985-50523399ef7d', 'name': '', 'network_id': 'b51eb33b-7c79-46ba-9423-a0ce34433ebb', 'tenant_id': 'aaf741cd215644308245542578883a8a', 'mac_address': 'fa:16:3e:8f:2e:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a9a6ab5f-4296-4103-9658-5468573f9ddb', 'device_owner': 'network:router_interface', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': '38eb0166-07db-4a38-bf20-2ae69f7dbb32', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:18Z', 'updated_at': '2021-05-31T16:26:24Z', 'revision_number': 4, 'project_id': 'aaf741cd215644308245542578883a8a', 'subnets': [{'id': '38eb0166-07db-4a38-bf20-2ae69f7dbb32', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:26:25.875989 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39f95553-da7b-498a-b86d-518d6c6f4ca9 req-b4df0259-ce03-4a81-875d-b2ded7c80fea tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:25.877935 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-39f95553-da7b-498a-b86d-518d6c6f4ca9 req-b4df0259-ce03-4a81-875d-b2ded7c80fea tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.0964258
May 31 16:26:25.929149 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-39f95553-da7b-498a-b86d-518d6c6f4ca9 req-442f89c0-3523-48ca-8f8c-2ac4bfcccbd1 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0448937
May 31 16:26:26.353746 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 58810335-9a49-4d92-a985-50523399ef7d up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:26:26.421086 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning for port 58810335-9a49-4d92-a985-50523399ef7d completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:26:26.426528 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 58810335-9a49-4d92-a985-50523399ef7d triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:26:26.426914 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:26.547300 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:26.579131 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] For port 58810335-9a49-4d92-a985-50523399ef7d, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=58810335-9a49-4d92-a985-50523399ef7d,segment=NetworkSegment(55db7c87-2a89-44db-9f17-28d7a4f933d2),segment_id=55db7c87-2a89-44db-9f17-28d7a4f933d2)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:26:26.583382 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:26.585150 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:26.654650 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Pushing event updated for resources: {'Port': ['ID=58810335-9a49-4d92-a985-50523399ef7d,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:26.658287 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:27.130088 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a40f1acb-96c0-411d-8d20-b4c0ffbfd0dd req-3813713a-05ac-4150-a74d-4e2e3abf1d29 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:27.131551 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a40f1acb-96c0-411d-8d20-b4c0ffbfd0dd req-3813713a-05ac-4150-a74d-4e2e3abf1d29 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.0807631
May 31 16:26:27.182857 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a40f1acb-96c0-411d-8d20-b4c0ffbfd0dd req-4130c42f-f2ad-4fdf-ac65-2e4826a35e5f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0453434
May 31 16:26:28.347829 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 58810335-9a49-4d92-a985-50523399ef7d up at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:26:28.381175 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5f13df9-6af9-4655-be81-d2dc8306387b req-0a849120-16a1-4c12-9905-6cae79403a4e tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:28.382676 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c5f13df9-6af9-4655-be81-d2dc8306387b req-0a849120-16a1-4c12-9905-6cae79403a4e tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.0890427
May 31 16:26:28.418844 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Provisioning complete for port 58810335-9a49-4d92-a985-50523399ef7d triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:26:28.419486 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:28.428812 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c5f13df9-6af9-4655-be81-d2dc8306387b req-bf33df24-40d3-4a59-a2cf-f716b813557a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0403051
May 31 16:26:29.639122 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f93d1b85-9b65-4a1a-b264-c63945ea2bd2 req-96ef4f55-205d-4f5b-b8fa-42b7a49bae6e tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:29.640614 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f93d1b85-9b65-4a1a-b264-c63945ea2bd2 req-96ef4f55-205d-4f5b-b8fa-42b7a49bae6e tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.0965459
May 31 16:26:29.688366 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f93d1b85-9b65-4a1a-b264-c63945ea2bd2 req-6298cd44-2043-4984-a9a8-f2d4bd8e79b4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0414090
May 31 16:26:30.882396 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47707167-10b9-42ac-b3d7-cc4a17ee4a11 req-bed65989-eed9-4fa7-a57b-af2542096f9f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:30.883907 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-47707167-10b9-42ac-b3d7-cc4a17ee4a11 req-bed65989-eed9-4fa7-a57b-af2542096f9f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.0844924
May 31 16:26:30.929028 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-47707167-10b9-42ac-b3d7-cc4a17ee4a11 req-cef815dd-957e-4f77-9cc0-cca0222578dc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0393128
May 31 16:26:32.136368 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9ed5da3-742e-4244-90c0-f86ff963e8d6 req-6f323e37-43c3-434e-b452-dc9bc5581081 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:32.137839 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d9ed5da3-742e-4244-90c0-f86ff963e8d6 req-6f323e37-43c3-434e-b452-dc9bc5581081 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.0856564
May 31 16:26:32.185253 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d9ed5da3-742e-4244-90c0-f86ff963e8d6 req-3942558a-cafa-462a-a0b7-13443b96ee57 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0414014
May 31 16:26:33.037223 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 49427db6-0261-4969-89c1-47664fa8a818 details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:26:33.172590 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 49427db6-0261-4969-89c1-47664fa8a818, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=49427db6-0261-4969-89c1-47664fa8a818,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:26:33.185277 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': '49427db6-0261-4969-89c1-47664fa8a818', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'port_id': '49427db6-0261-4969-89c1-47664fa8a818', 'mac_address': 'fa:16:3e:ca:d5:90', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 806, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:26:33.241156 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:33.259180 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 49427db6-0261-4969-89c1-47664fa8a818 {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:26:33.277394 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 49427db6-0261-4969-89c1-47664fa8a818, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=49427db6-0261-4969-89c1-47664fa8a818,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:26:33.281399 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:33.283411 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:33.355880 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=49427db6-0261-4969-89c1-47664fa8a818,revision_number=6']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:33.358856 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:33.383292 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d980792-ca58-4bee-bc24-813d6b77f297 req-96282dc7-2627-4d38-afe7-1741fa2a2479 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:33.384756 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6d980792-ca58-4bee-bc24-813d6b77f297 req-96282dc7-2627-4d38-afe7-1741fa2a2479 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 945 time: 0.0851355
May 31 16:26:33.407490 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['49427db6-0261-4969-89c1-47664fa8a818'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:26:33.429489 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6d980792-ca58-4bee-bc24-813d6b77f297 req-d5fd3ff7-8d60-4703-97cf-549ff6e65927 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0389130
May 31 16:26:34.692714 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d0921c9-c60f-41a2-92eb-0ca935491256 req-bf0a8b57-8783-46a1-8f53-0403373fe4a5 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:34.694410 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0d0921c9-c60f-41a2-92eb-0ca935491256 req-bf0a8b57-8783-46a1-8f53-0403373fe4a5 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 945 time: 0.1425433
May 31 16:26:34.755746 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0d0921c9-c60f-41a2-92eb-0ca935491256 req-c5a4d5f9-35e3-4afc-b9a8-456656225052 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0552723
May 31 16:26:35.011767 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-89cab00e-9a7b-4aef-bc94-22b550bf7e50 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:35.044579 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 49427db6-0261-4969-89c1-47664fa8a818 up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:26:35.143306 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port 49427db6-0261-4969-89c1-47664fa8a818 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:26:35.143870 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:35.282346 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:35.316200 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '61f2d7a8-c7cd-4a2d-9a17-4654f91ad264', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '49427db6-0261-4969-89c1-47664fa8a818'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:26:35.318800 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b062127c-0dec-4428-bf0c-829417990e58" -d '{"events": [{"server_uuid": "61f2d7a8-c7cd-4a2d-9a17-4654f91ad264", "name": "network-vif-plugged", "status": "completed", "tag": "49427db6-0261-4969-89c1-47664fa8a818"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:26:35.327219 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 49427db6-0261-4969-89c1-47664fa8a818, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=49427db6-0261-4969-89c1-47664fa8a818,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:26:35.334355 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:35.337179 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:35.379588 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:26:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-94f17177-3af2-4f79-80a2-76f85032ed97 x-openstack-request-id: req-94f17177-3af2-4f79-80a2-76f85032ed97 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:26:35.379890 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "61f2d7a8-c7cd-4a2d-9a17-4654f91ad264", "name": "network-vif-plugged", "status": "completed", "tag": "49427db6-0261-4969-89c1-47664fa8a818", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:26:35.380154 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-94f17177-3af2-4f79-80a2-76f85032ed97 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:26:35.381570 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '61f2d7a8-c7cd-4a2d-9a17-4654f91ad264', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '49427db6-0261-4969-89c1-47664fa8a818', 'code': 200}
May 31 16:26:35.421174 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=49427db6-0261-4969-89c1-47664fa8a818,revision_number=7']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:35.424850 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:35.990774 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b87929d1-f3a3-4d30-a360-02729b8d22c1 req-7fd559bb-3bce-40e5-8a3c-78e0babeffc7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:35.993279 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b87929d1-f3a3-4d30-a360-02729b8d22c1 req-7fd559bb-3bce-40e5-8a3c-78e0babeffc7 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.1055131
May 31 16:26:36.058710 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b87929d1-f3a3-4d30-a360-02729b8d22c1 req-b3708bbc-360e-4b62-b5b1-53b8c293b2a5 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0514088
May 31 16:26:37.311493 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bf1c5e6-4d71-4107-aee6-9e039cba585d req-74de0b0b-6431-4520-b3f7-7147ae66f235 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:37.313200 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3bf1c5e6-4d71-4107-aee6-9e039cba585d req-74de0b0b-6431-4520-b3f7-7147ae66f235 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.0879846
May 31 16:26:37.364381 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3bf1c5e6-4d71-4107-aee6-9e039cba585d req-2d07f776-de50-4a1d-8776-10380ec1ee24 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0435936
May 31 16:26:37.895844 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:38.223658 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-fee0e8d1-240b-4d5d-9c11-d7ae02485f0b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:38.560474 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa69f50a-c366-4d20-9dda-67a8a9d255f1 req-32754e8a-4fa8-4f0e-9cd1-a528320f3c80 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:38.561965 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-fa69f50a-c366-4d20-9dda-67a8a9d255f1 req-32754e8a-4fa8-4f0e-9cd1-a528320f3c80 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.0870042
May 31 16:26:38.606796 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-fa69f50a-c366-4d20-9dda-67a8a9d255f1 req-8706f591-fc5e-4f1a-98f8-64880fcf2b18 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0386453
May 31 16:26:39.165920 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:39.822245 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9bf50a0-9416-4583-a016-55d0fb74203f req-c245decc-6b31-49bc-b285-903506b99b3c tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:39.824061 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d9bf50a0-9416-4583-a016-55d0fb74203f req-c245decc-6b31-49bc-b285-903506b99b3c tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.0984628
May 31 16:26:39.876891 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d9bf50a0-9416-4583-a016-55d0fb74203f req-343cba31-c41f-4e1c-a47d-f6a4fb808c38 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0454893
May 31 16:26:40.400359 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-575cce97-3f47-4b21-9978-eef79ff4563b tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-529917592&fields=id&tenant_id=ff0bbba58394409987a388bb38868b4e HTTP/1.1" status: 200  len: 267 time: 0.0480320
May 31 16:26:40.667593 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-29eb7744-7124-4101-ba0a-b04e34362888 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:40.669402 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-29eb7744-7124-4101-ba0a-b04e34362888 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/networks?id=0e202b3d-d60d-481f-bf3a-e31943668c98 HTTP/1.1" status: 200  len: 808 time: 0.2608447
May 31 16:26:40.685889 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-36169fdc-cf4b-42bf-bd2f-3de457375eb3 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/quotas/ff0bbba58394409987a388bb38868b4e HTTP/1.1" status: 200  len: 375 time: 0.0098183
May 31 16:26:40.783606 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-689c934c-3915-44fb-9e84-32265466cf4a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Synchronizing usage tracker for tenant:ff0bbba58394409987a388bb38868b4e on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:26:40.811933 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-689c934c-3915-44fb-9e84-32265466cf4a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Unset dirty status for tenant:ff0bbba58394409987a388bb38868b4e on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:26:40.814289 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-689c934c-3915-44fb-9e84-32265466cf4a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=ff0bbba58394409987a388bb38868b4e&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1221447
May 31 16:26:40.885811 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:40.981580 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-f1e906c7-acfa-4edb-8016-a7bfd4b2c41e service neutron] 10.222.0.43 "GET /v2.0/networks/0e202b3d-d60d-481f-bf3a-e31943668c98?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1509757
May 31 16:26:41.198068 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-96affb86-95c6-4a84-bd50-011d63caf03b service neutron] 10.222.0.43 "GET /v2.0/networks/0e202b3d-d60d-481f-bf3a-e31943668c98?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2062213
May 31 16:26:41.214886 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6125801-dfa9-41c6-b42a-9b90e19049e8 req-7e509df9-1768-47c6-bc24-f9b77ce4568d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:41.216407 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f6125801-dfa9-41c6-b42a-9b90e19049e8 req-7e509df9-1768-47c6-bc24-f9b77ce4568d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.1982687
May 31 16:26:41.271582 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f6125801-dfa9-41c6-b42a-9b90e19049e8 req-1b8302c4-9559-4467-a773-dd4696a6e3c3 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0478680
May 31 16:26:41.675255 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a2a7fc2a-048f-4ccb-8747-e7a613733580 req-7b29eb5c-e402-4736-9cdc-5b8e9c2ad5ec tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 210 time: 0.0526237
May 31 16:26:42.558459 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0237224-21cb-489d-8a8e-0d2bf3176211 req-939ea84a-c1b6-4e3c-abc7-5f212c760751 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:42.561427 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b0237224-21cb-489d-8a8e-0d2bf3176211 req-939ea84a-c1b6-4e3c-abc7-5f212c760751 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.1146524
May 31 16:26:42.631040 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b0237224-21cb-489d-8a8e-0d2bf3176211 req-7b57e84d-2d63-4944-b0db-1af4ad6fb6b9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0626833
May 31 16:26:42.868510 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f599cea5-8c69-4605-be6a-b801d2af9b24 req-4926595e-4573-4139-bc33-8b822aeebf4b tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 210 time: 0.0647449
May 31 16:26:43.109304 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-c023f1f8-42e2-4ef7-a6c1-1dc78583e59b tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:43.110988 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-c023f1f8-42e2-4ef7-a6c1-1dc78583e59b tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.63 "GET /v2.0/networks?id=0e202b3d-d60d-481f-bf3a-e31943668c98 HTTP/1.1" status: 200  len: 808 time: 0.1851687
May 31 16:26:43.188557 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-e56ab1aa-1f24-40e9-b44d-c862693854c9 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.63 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ff0bbba58394409987a388bb38868b4e HTTP/1.1" status: 200  len: 379 time: 0.0661209
May 31 16:26:43.198401 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-e56ab469-f94c-41eb-9d8d-d41826e5f54a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Request body: {'port': {'device_id': 'd9e580af-3588-40d6-9e2a-60c321af3d1e', 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98', 'admin_state_up': True, 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'security_groups': ['98f3ba1c-e634-454a-bd75-897eb9d73543']}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:26:43.351759 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-e56ab469-f94c-41eb-9d8d-d41826e5f54a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:26:43.363215 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-e56ab469-f94c-41eb-9d8d-d41826e5f54a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:26:43.377955 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-e56ab469-f94c-41eb-9d8d-d41826e5f54a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Made reservation on behalf of ff0bbba58394409987a388bb38868b4e for: {'port': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:26:43.381747 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-e56ab469-f94c-41eb-9d8d-d41826e5f54a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:43.561932 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-e56ab469-f94c-41eb-9d8d-d41826e5f54a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Allocated IP 172.20.0.13 (0e202b3d-d60d-481f-bf3a-e31943668c98/20f6caad-2e13-4108-af8f-f9c2336ccde2/e42a29cb-c29c-41f8-9cfb-6379c167a596) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:26:43.872628 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-e56ab469-f94c-41eb-9d8d-d41826e5f54a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:43.890935 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.provisioning_blocks [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-e56ab469-f94c-41eb-9d8d-d41826e5f54a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Transition to ACTIVE for port object e42a29cb-c29c-41f8-9cfb-6379c167a596 will not be triggered until provisioned by entity DHCP. {{(pid=91764) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:26:43.960954 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-e56ab469-f94c-41eb-9d8d-d41826e5f54a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:43.981694 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:44.108582 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-e56ab469-f94c-41eb-9d8d-d41826e5f54a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Network 0e202b3d-d60d-481f-bf3a-e31943668c98 is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:26:44.125804 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06db8f4c-33d1-431e-adfa-7d72f414be76 req-eb567932-7338-49ee-9b7f-4271cbe15ab5 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:44.128055 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-06db8f4c-33d1-431e-adfa-7d72f414be76 req-eb567932-7338-49ee-9b7f-4271cbe15ab5 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.3706183
May 31 16:26:44.130247 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-e56ab469-f94c-41eb-9d8d-d41826e5f54a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:26:44.133170 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-e56ab469-f94c-41eb-9d8d-d41826e5f54a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:26:44.215758 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e56ab469-f94c-41eb-9d8d-d41826e5f54a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Pushing event updated for resources: {'Port': ['ID=e42a29cb-c29c-41f8-9cfb-6379c167a596,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:44.219825 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-e56ab469-f94c-41eb-9d8d-d41826e5f54a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.238s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:44.316710 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-e56ab469-f94c-41eb-9d8d-d41826e5f54a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:44.317097 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-e56ab469-f94c-41eb-9d8d-d41826e5f54a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:44.325354 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-06db8f4c-33d1-431e-adfa-7d72f414be76 req-305eac4e-3b51-4406-92c9-701fba8e0bd6 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1600521
May 31 16:26:44.376637 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5f09968-0ada-45e8-9bb0-7528c41ad651 req-c10ecdc2-14ee-4446-be2a-b73901f5102a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:44.377722 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-c5f09968-0ada-45e8-9bb0-7528c41ad651 req-c10ecdc2-14ee-4446-be2a-b73901f5102a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Synchronizing usage tracker for tenant:ff0bbba58394409987a388bb38868b4e on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:26:44.383490 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-e56ab469-f94c-41eb-9d8d-d41826e5f54a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.63 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.1895516
May 31 16:26:44.398281 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-fb5c9f0b-1419-4bca-b641-55cde690003c None None] Provisioning for port e42a29cb-c29c-41f8-9cfb-6379c167a596 completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:26:44.403552 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Request body: {'port': {'device_id': 'd9e580af-3588-40d6-9e2a-60c321af3d1e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79381'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:26:44.406074 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-fb5c9f0b-1419-4bca-b641-55cde690003c None None] Provisioning complete for port e42a29cb-c29c-41f8-9cfb-6379c167a596 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:26:44.406709 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-fb5c9f0b-1419-4bca-b641-55cde690003c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:44.478255 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-fb5c9f0b-1419-4bca-b641-55cde690003c None None] Port e42a29cb-c29c-41f8-9cfb-6379c167a596 cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:26:44.545126 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-c5f09968-0ada-45e8-9bb0-7528c41ad651 req-c10ecdc2-14ee-4446-be2a-b73901f5102a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Unset dirty status for tenant:ff0bbba58394409987a388bb38868b4e on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:26:44.545952 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c5f09968-0ada-45e8-9bb0-7528c41ad651 req-c10ecdc2-14ee-4446-be2a-b73901f5102a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 932 time: 0.5052752
May 31 16:26:44.662425 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c5f09968-0ada-45e8-9bb0-7528c41ad651 req-1c784b68-b8d3-483c-94e7-8b45fc964fa7 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1009934
May 31 16:26:44.679471 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:45.069330 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e42a29cb-c29c-41f8-9cfb-6379c167a596 {{(pid=91764) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:26:45.077082 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Notify callbacks [] for port, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:45.094085 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.provisioning_blocks [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Transition to ACTIVE for port object e42a29cb-c29c-41f8-9cfb-6379c167a596 will not be triggered until provisioned by entity L2. {{(pid=91764) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:26:45.098188 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:45.102052 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c2105b5d-993a-43f2-9e8b-b5f2f303c0f3 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:45.172288 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:26:45.232783 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Pushing event updated for resources: {'Port': ['ID=e42a29cb-c29c-41f8-9cfb-6379c167a596,revision_number=2']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:45.236923 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:45.356558 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Attempting to bind port e42a29cb-c29c-41f8-9cfb-6379c167a596 on host hv-cinder-79381 for vnic_type normal with profile  {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:26:45.357028 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Attempting to bind port e42a29cb-c29c-41f8-9cfb-6379c167a596 by drivers openvswitch,hyperv on host hv-cinder-79381 at level 0 using segments [{'id': '1e70bee6-dfc7-4037-8e59-6c6e25de8649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 823, 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98'}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:26:45.357487 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Attempting to bind port e42a29cb-c29c-41f8-9cfb-6379c167a596 on network 0e202b3d-d60d-481f-bf3a-e31943668c98 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:26:45.364032 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Port e42a29cb-c29c-41f8-9cfb-6379c167a596 on network 0e202b3d-d60d-481f-bf3a-e31943668c98 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79381 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 31 16:26:45.364473 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Attempting to bind port e42a29cb-c29c-41f8-9cfb-6379c167a596 on network 0e202b3d-d60d-481f-bf3a-e31943668c98 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:26:45.372065 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Checking agent: {'id': '4bed2638-4d91-4afb-bf81-aacca8584621', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79381', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'started_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 26, 20), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:26:45.372416 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Checking segment: {'id': '1e70bee6-dfc7-4037-8e59-6c6e25de8649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 823, 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:26:45.373132 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Bound using segment: {'id': '1e70bee6-dfc7-4037-8e59-6c6e25de8649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 823, 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98'} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:26:45.373841 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Bound port: e42a29cb-c29c-41f8-9cfb-6379c167a596, host: hv-cinder-79381, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1e70bee6-dfc7-4037-8e59-6c6e25de8649', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 823, 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98'}}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:26:45.374379 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:45.514697 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] For port e42a29cb-c29c-41f8-9cfb-6379c167a596, host hv-cinder-79381, cleared binding levels {{(pid=91764) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:26:45.527119 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] For port e42a29cb-c29c-41f8-9cfb-6379c167a596, host hv-cinder-79381, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=e42a29cb-c29c-41f8-9cfb-6379c167a596,segment=NetworkSegment(1e70bee6-dfc7-4037-8e59-6c6e25de8649),segment_id=1e70bee6-dfc7-4037-8e59-6c6e25de8649)] {{(pid=91764) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:26:45.531485 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:45.536944 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-e56ab469-f94c-41eb-9d8d-d41826e5f54a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:45.602630 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:45.603239 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:45.604591 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] 10.222.0.63 "PUT /v2.0/ports/e42a29cb-c29c-41f8-9cfb-6379c167a596 HTTP/1.1" status: 200  len: 1094 time: 1.2085638
May 31 16:26:45.608331 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd9e580af-3588-40d6-9e2a-60c321af3d1e', 'tag': 'e42a29cb-c29c-41f8-9cfb-6379c167a596'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:26:45.610703 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8d3631a5-b67b-45b0-9952-c7b0a2b25c79" -d '{"events": [{"name": "network-changed", "server_uuid": "d9e580af-3588-40d6-9e2a-60c321af3d1e", "tag": "e42a29cb-c29c-41f8-9cfb-6379c167a596"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:26:45.639061 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77a7467b-2213-444c-a476-13f4f6dcaf7e req-4f29b1bf-764f-4e87-aa41-2e77c2d589e3 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:45.639061 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-77a7467b-2213-444c-a476-13f4f6dcaf7e req-4f29b1bf-764f-4e87-aa41-2e77c2d589e3 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.1781201
May 31 16:26:45.660616 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Pushing event updated for resources: {'Port': ['ID=e42a29cb-c29c-41f8-9cfb-6379c167a596,revision_number=3']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:45.667122 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:45.685610 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:26:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6b9f447f-c49f-4438-a575-72a77cf2c891 x-openstack-request-id: req-6b9f447f-c49f-4438-a575-72a77cf2c891 {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:26:45.685899 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d9e580af-3588-40d6-9e2a-60c321af3d1e", "tag": "e42a29cb-c29c-41f8-9cfb-6379c167a596", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:26:45.686190 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-6b9f447f-c49f-4438-a575-72a77cf2c891 {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:26:45.686627 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd9e580af-3588-40d6-9e2a-60c321af3d1e', 'tag': 'e42a29cb-c29c-41f8-9cfb-6379c167a596', 'status': 'completed', 'code': 200}
May 31 16:26:45.694976 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-77a7467b-2213-444c-a476-13f4f6dcaf7e req-d0c78e03-ee07-4a4b-b536-12ef76832719 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0545263
May 31 16:26:45.779424 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-cffd95a6-aa5d-47b4-ae36-2290810b9990 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:45.780995 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-cffd95a6-aa5d-47b4-ae36-2290810b9990 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=ff0bbba58394409987a388bb38868b4e&device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 1097 time: 0.0848777
May 31 16:26:45.847039 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43a29aec-238e-4c0a-8c3d-2b803aa2f088 req-66bbbb8d-652a-4fde-bfa2-970d714e6700 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:45.848523 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-43a29aec-238e-4c0a-8c3d-2b803aa2f088 req-66bbbb8d-652a-4fde-bfa2-970d714e6700 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=12203182731d4a61acb7fc5914aef425&device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 1099 time: 0.0800827
May 31 16:26:45.895310 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-f6be8e8d-7b99-424d-b305-ed678ad33ad5 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=e42a29cb-c29c-41f8-9cfb-6379c167a596 HTTP/1.1" status: 200  len: 217 time: 0.0775371
May 31 16:26:45.973085 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-b539dcda-44b6-43e6-9c59-353bed760245 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:45.974551 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-b539dcda-44b6-43e6-9c59-353bed760245 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=20f6caad-2e13-4108-af8f-f9c2336ccde2 HTTP/1.1" status: 200  len: 847 time: 0.0725901
May 31 16:26:45.985343 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43a29aec-238e-4c0a-8c3d-2b803aa2f088 req-8f1fefe4-ab28-4cdd-b858-95f450a7ddac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:45.986710 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3147a877-8709-44cb-8acc-ca1a1a3869f4 req-8f183346-1620-4444-ae60-311993d85c3d tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:45.987492 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-43a29aec-238e-4c0a-8c3d-2b803aa2f088 req-8f1fefe4-ab28-4cdd-b858-95f450a7ddac service neutron] 10.222.0.63 "GET /v2.0/networks?id=be7d7603-734f-43bb-92a8-ed07a835aeb5 HTTP/1.1" status: 200  len: 917 time: 0.1317165
May 31 16:26:45.988291 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3147a877-8709-44cb-8acc-ca1a1a3869f4 req-8f183346-1620-4444-ae60-311993d85c3d tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 944 time: 0.2036300
May 31 16:26:46.081130 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3147a877-8709-44cb-8acc-ca1a1a3869f4 req-ddeefd5c-b25c-4714-86fa-7aa0678298fd tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0605733
May 31 16:26:46.095531 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-55053659-2aec-4a63-91f3-384211262aa3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:46.097002 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-55053659-2aec-4a63-91f3-384211262aa3 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=0e202b3d-d60d-481f-bf3a-e31943668c98&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1078427
May 31 16:26:46.193100 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-43a29aec-238e-4c0a-8c3d-2b803aa2f088 req-ba5d6942-78be-45c5-85b5-6a6a81378a0c service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=49427db6-0261-4969-89c1-47664fa8a818 HTTP/1.1" status: 200  len: 1002 time: 0.1984112
May 31 16:26:46.236952 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-c77ecfea-aac9-47d5-aadb-fcf6bded1a93 service neutron] 10.222.0.63 "GET /v2.0/networks/0e202b3d-d60d-481f-bf3a-e31943668c98?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1323266
May 31 16:26:46.258201 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43a29aec-238e-4c0a-8c3d-2b803aa2f088 req-27523730-c193-407b-803b-6b414642ba62 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:46.259636 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-43a29aec-238e-4c0a-8c3d-2b803aa2f088 req-27523730-c193-407b-803b-6b414642ba62 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=eb5363fe-ee39-4adc-b299-6098caad681d HTTP/1.1" status: 200  len: 855 time: 0.0588238
May 31 16:26:46.340425 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43a29aec-238e-4c0a-8c3d-2b803aa2f088 req-a64e0eed-ccec-4b3b-9890-afbe813a3cb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:46.341882 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-43a29aec-238e-4c0a-8c3d-2b803aa2f088 req-a64e0eed-ccec-4b3b-9890-afbe813a3cb5 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=be7d7603-734f-43bb-92a8-ed07a835aeb5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0750320
May 31 16:26:46.472560 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8bb9b677-ddec-42b4-adc1-35c67533359e req-8141ce02-1e85-4473-8731-8426cce96c43 service neutron] 10.222.0.63 "GET /v2.0/networks/0e202b3d-d60d-481f-bf3a-e31943668c98?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2276325
May 31 16:26:46.478740 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-43a29aec-238e-4c0a-8c3d-2b803aa2f088 req-5ccb28e2-85f6-4c4d-9446-8345156fe679 service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1295853
May 31 16:26:46.593384 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d3631a5-b67b-45b0-9952-c7b0a2b25c79 req-9ebe4061-8575-40a3-844a-d5f8dd27b7df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:46.594827 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8d3631a5-b67b-45b0-9952-c7b0a2b25c79 req-9ebe4061-8575-40a3-844a-d5f8dd27b7df service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=ff0bbba58394409987a388bb38868b4e&device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 1097 time: 0.0744777
May 31 16:26:46.616309 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-43a29aec-238e-4c0a-8c3d-2b803aa2f088 req-130d9254-999b-495b-911a-817cb0ad59a0 service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1308272
May 31 16:26:46.730765 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d3631a5-b67b-45b0-9952-c7b0a2b25c79 req-2b806ef9-570f-4ede-9f23-bbc2b429d7f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:46.732213 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8d3631a5-b67b-45b0-9952-c7b0a2b25c79 req-2b806ef9-570f-4ede-9f23-bbc2b429d7f9 service neutron] 10.222.0.63 "GET /v2.0/networks?id=0e202b3d-d60d-481f-bf3a-e31943668c98 HTTP/1.1" status: 200  len: 909 time: 0.1304612
May 31 16:26:46.805950 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8d3631a5-b67b-45b0-9952-c7b0a2b25c79 req-daa855b1-6209-456c-afd6-de45d7fb6bcc service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=e42a29cb-c29c-41f8-9cfb-6379c167a596 HTTP/1.1" status: 200  len: 217 time: 0.0620253
May 31 16:26:46.924778 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d3631a5-b67b-45b0-9952-c7b0a2b25c79 req-ed1c335f-bca9-46cc-acad-dd6ddc4fe365 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:46.926149 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8d3631a5-b67b-45b0-9952-c7b0a2b25c79 req-ed1c335f-bca9-46cc-acad-dd6ddc4fe365 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=20f6caad-2e13-4108-af8f-f9c2336ccde2 HTTP/1.1" status: 200  len: 847 time: 0.1127310
May 31 16:26:46.996666 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d34d9cf8-76e9-445e-8252-5d626d39f441 req-95fc570f-cc33-4e89-87a8-84255d20c575 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:46.998143 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d34d9cf8-76e9-445e-8252-5d626d39f441 req-95fc570f-cc33-4e89-87a8-84255d20c575 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.1516211
May 31 16:26:47.054687 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d34d9cf8-76e9-445e-8252-5d626d39f441 req-ad70b4b5-a0b8-4b9f-b6f3-6aba538cb5e4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0485671
May 31 16:26:47.056699 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d3631a5-b67b-45b0-9952-c7b0a2b25c79 req-859b0ad0-6fa3-4f48-8b5d-0cba97e2933c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:47.058090 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8d3631a5-b67b-45b0-9952-c7b0a2b25c79 req-859b0ad0-6fa3-4f48-8b5d-0cba97e2933c service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=0e202b3d-d60d-481f-bf3a-e31943668c98&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1246908
May 31 16:26:47.236857 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8d3631a5-b67b-45b0-9952-c7b0a2b25c79 req-072c0a4d-86f0-4280-8828-4cf10a1ae84e service neutron] 10.222.0.63 "GET /v2.0/networks/0e202b3d-d60d-481f-bf3a-e31943668c98?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1702116
May 31 16:26:47.362312 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6a3f54a-fcee-4618-93c5-ccb24a082128 req-9c3946ec-2c9f-40cc-80d6-b19be25d7e1f tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:47.363761 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e6a3f54a-fcee-4618-93c5-ccb24a082128 req-9c3946ec-2c9f-40cc-80d6-b19be25d7e1f tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 944 time: 0.1752532
May 31 16:26:47.426322 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8d3631a5-b67b-45b0-9952-c7b0a2b25c79 req-fabe31cf-1a9b-4a0a-973c-ab6a46c768a1 service neutron] 10.222.0.63 "GET /v2.0/networks/0e202b3d-d60d-481f-bf3a-e31943668c98?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1790864
May 31 16:26:47.435873 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e6a3f54a-fcee-4618-93c5-ccb24a082128 req-74d06e0b-3e25-46ca-b32a-33f3061b4228 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0620809
May 31 16:26:48.245077 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae3d3ff-2dba-4f74-a2dc-f3243dd515b4 req-0c933c47-7f4b-43a2-b2c5-0691614a22bf tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:48.246554 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-fae3d3ff-2dba-4f74-a2dc-f3243dd515b4 req-0c933c47-7f4b-43a2-b2c5-0691614a22bf tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 946 time: 0.0807152
May 31 16:26:48.291520 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-fae3d3ff-2dba-4f74-a2dc-f3243dd515b4 req-1e34bf18-9ee6-4ce9-8feb-0ed6915a09b6 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0382333
May 31 16:26:48.628708 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81a53097-f9f1-48ef-8292-fd9f7e0a590b req-4b637c93-2761-47df-88b8-a89dbfe1265f tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:48.630210 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-81a53097-f9f1-48ef-8292-fd9f7e0a590b req-4b637c93-2761-47df-88b8-a89dbfe1265f tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 944 time: 0.0889001
May 31 16:26:48.684584 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-81a53097-f9f1-48ef-8292-fd9f7e0a590b req-b5b3b1fe-121d-462d-a178-4d87d9a1ec27 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0486853
May 31 16:26:49.136561 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 49427db6-0261-4969-89c1-47664fa8a818 no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:26:49.248824 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:49.276414 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '61f2d7a8-c7cd-4a2d-9a17-4654f91ad264', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '49427db6-0261-4969-89c1-47664fa8a818'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:26:49.278533 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0b354589-c3a3-4db8-96de-291b1c5d60ac" -d '{"events": [{"server_uuid": "61f2d7a8-c7cd-4a2d-9a17-4654f91ad264", "name": "network-vif-unplugged", "status": "completed", "tag": "49427db6-0261-4969-89c1-47664fa8a818"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:26:49.286775 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 49427db6-0261-4969-89c1-47664fa8a818, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=49427db6-0261-4969-89c1-47664fa8a818,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:26:49.290957 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:49.292748 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:49.326909 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Mon, 31 May 2021 16:26:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-af61de19-c80c-437e-8726-a523d74e0e31 x-openstack-request-id: req-af61de19-c80c-437e-8726-a523d74e0e31 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:26:49.327188 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "61f2d7a8-c7cd-4a2d-9a17-4654f91ad264", "name": "network-vif-unplugged", "status": "failed", "tag": "49427db6-0261-4969-89c1-47664fa8a818", "code": 422}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:26:49.327443 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-af61de19-c80c-437e-8726-a523d74e0e31 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:26:49.327879 dv-cinder-793814-1-iscsi neutron-server[91765]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '61f2d7a8-c7cd-4a2d-9a17-4654f91ad264', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '49427db6-0261-4969-89c1-47664fa8a818', 'code': 422} returned with failed status
May 31 16:26:49.362771 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=49427db6-0261-4969-89c1-47664fa8a818,revision_number=8']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:49.369910 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:49.370255 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:49.370597 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:49.370927 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:49.371253 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:49.371579 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:49.371902 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:49.372223 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:49.372549 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:49.372863 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:49.373183 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:49.373498 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:26:49.378226 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:49.483290 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9322036-9b13-4ad3-b95e-c3950d9f68ee req-93922bc5-b5cc-4528-af6f-724cd9510543 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:49.484727 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f9322036-9b13-4ad3-b95e-c3950d9f68ee req-93922bc5-b5cc-4528-af6f-724cd9510543 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 944 time: 0.0785956
May 31 16:26:49.528870 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f9322036-9b13-4ad3-b95e-c3950d9f68ee req-057c130c-c523-49ff-a0ce-3b6d72742853 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0382431
May 31 16:26:49.658601 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:49.889097 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33c155e8-dfa4-45a7-8359-319af106eab9 req-b1c800d8-426e-4ced-970e-b4ff339b7b3d tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:49.890604 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-33c155e8-dfa4-45a7-8359-319af106eab9 req-b1c800d8-426e-4ced-970e-b4ff339b7b3d tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 944 time: 0.0979576
May 31 16:26:49.940963 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-33c155e8-dfa4-45a7-8359-319af106eab9 req-787f4067-9aab-44b4-8a0b-a1fd6fdece57 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0437646
May 31 16:26:50.995693 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61347c01-7904-4b5d-8f9d-8cb0774dfaff req-b11ad085-822f-42bf-8c9c-65e795e6d25c tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:50.997141 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-61347c01-7904-4b5d-8f9d-8cb0774dfaff req-b11ad085-822f-42bf-8c9c-65e795e6d25c tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 944 time: 0.1393623
May 31 16:26:51.004169 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0a15224e-5cd3-419c-b8aa-672e334cc613 req-2beed07f-9bc4-409b-ad62-7473aa469cbd service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1097248
May 31 16:26:51.044263 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-61347c01-7904-4b5d-8f9d-8cb0774dfaff req-f9e91c30-01c3-4ad1-83ca-c54f77a2f172 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0391471
May 31 16:26:51.135658 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-327befbd-a6f8-4dc5-a056-6120a5c87b14 req-51416ad6-d52c-41a1-85be-b10c7ed921a7 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:51.137129 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-327befbd-a6f8-4dc5-a056-6120a5c87b14 req-51416ad6-d52c-41a1-85be-b10c7ed921a7 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 944 time: 0.0849850
May 31 16:26:51.298782 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-327befbd-a6f8-4dc5-a056-6120a5c87b14 req-839727b0-9067-4140-845c-b2579c4fe25d tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1557367
May 31 16:26:52.000008 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a15224e-5cd3-419c-b8aa-672e334cc613 req-fc1b51ee-a4e0-48b7-9fbb-df17996c32b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:52.002442 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0a15224e-5cd3-419c-b8aa-672e334cc613 req-fc1b51ee-a4e0-48b7-9fbb-df17996c32b2 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264&tenant_id=12203182731d4a61acb7fc5914aef425 HTTP/1.1" status: 200  len: 1097 time: 0.0727363
May 31 16:26:52.113760 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a15224e-5cd3-419c-b8aa-672e334cc613 req-5c1beff2-18c2-42e7-8ba7-e2145140ce3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:52.115224 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0a15224e-5cd3-419c-b8aa-672e334cc613 req-5c1beff2-18c2-42e7-8ba7-e2145140ce3c service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=12203182731d4a61acb7fc5914aef425&device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 1097 time: 0.0786588
May 31 16:26:52.340490 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3aa90eec-7948-4961-b576-5111a69830ed req-5fb44017-8609-4818-91dd-9c07b90a3125 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:52.341968 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3aa90eec-7948-4961-b576-5111a69830ed req-5fb44017-8609-4818-91dd-9c07b90a3125 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 944 time: 0.1778049
May 31 16:26:52.343121 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a15224e-5cd3-419c-b8aa-672e334cc613 req-2eb911c3-515a-4650-802b-56996447ce6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:52.344422 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0a15224e-5cd3-419c-b8aa-672e334cc613 req-2eb911c3-515a-4650-802b-56996447ce6c service neutron] 10.222.0.63 "GET /v2.0/networks?id=be7d7603-734f-43bb-92a8-ed07a835aeb5 HTTP/1.1" status: 200  len: 917 time: 0.2028768
May 31 16:26:52.511461 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3aa90eec-7948-4961-b576-5111a69830ed req-1af67641-13dd-4557-b343-c17bf8f7d6eb tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1630421
May 31 16:26:52.535174 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0a15224e-5cd3-419c-b8aa-672e334cc613 req-b8da5c4a-5847-43ba-b845-a282bd4a7b78 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=49427db6-0261-4969-89c1-47664fa8a818 HTTP/1.1" status: 200  len: 1000 time: 0.1732426
May 31 16:26:52.602643 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96609095-4cb0-4375-9508-1b655df86098 req-97211d1e-9fdb-45a4-a136-efeaee07f9b5 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:52.604134 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-96609095-4cb0-4375-9508-1b655df86098 req-97211d1e-9fdb-45a4-a136-efeaee07f9b5 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 944 time: 0.1910949
May 31 16:26:52.639600 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a15224e-5cd3-419c-b8aa-672e334cc613 req-e172888b-ed44-462e-8663-b3556d1d6ca2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:52.640999 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0a15224e-5cd3-419c-b8aa-672e334cc613 req-e172888b-ed44-462e-8663-b3556d1d6ca2 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=eb5363fe-ee39-4adc-b299-6098caad681d HTTP/1.1" status: 200  len: 855 time: 0.0976880
May 31 16:26:52.708031 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-96609095-4cb0-4375-9508-1b655df86098 req-507e583c-970d-4725-bfc7-6310015d9cda tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0953827
May 31 16:26:52.744169 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a15224e-5cd3-419c-b8aa-672e334cc613 req-f7ccf844-1a92-4932-b71b-e5d7f6a203fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:52.744169 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0a15224e-5cd3-419c-b8aa-672e334cc613 req-f7ccf844-1a92-4932-b71b-e5d7f6a203fa service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=be7d7603-734f-43bb-92a8-ed07a835aeb5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0872266
May 31 16:26:52.885720 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0a15224e-5cd3-419c-b8aa-672e334cc613 req-ad322688-92fc-42b6-8230-edfa147f005b service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1384542
May 31 16:26:53.053350 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0a15224e-5cd3-419c-b8aa-672e334cc613 req-480561e3-869e-4cf2-afc7-bf8508e6c82f service neutron] 10.222.0.63 "GET /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1600559
May 31 16:26:53.159369 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device e42a29cb-c29c-41f8-9cfb-6379c167a596 details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:26:53.237890 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a5cc4a9-b43e-4af6-a127-69c71b347289 req-9986b885-62b4-49ea-b615-6d395c918c90 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:53.239410 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6a5cc4a9-b43e-4af6-a127-69c71b347289 req-9986b885-62b4-49ea-b615-6d395c918c90 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.0846066
May 31 16:26:53.289698 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6a5cc4a9-b43e-4af6-a127-69c71b347289 req-d56b8aa6-6f23-47a9-8a6d-bfc13ce8142b tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0428822
May 31 16:26:53.300044 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port e42a29cb-c29c-41f8-9cfb-6379c167a596, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=e42a29cb-c29c-41f8-9cfb-6379c167a596,segment=NetworkSegment(1e70bee6-dfc7-4037-8e59-6c6e25de8649),segment_id=1e70bee6-dfc7-4037-8e59-6c6e25de8649)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:26:53.315443 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': 'e42a29cb-c29c-41f8-9cfb-6379c167a596', 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98', 'port_id': 'e42a29cb-c29c-41f8-9cfb-6379c167a596', 'mac_address': 'fa:16:3e:0a:33:5d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 823, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '20f6caad-2e13-4108-af8f-f9c2336ccde2', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:26:53.377244 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:53.394441 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e42a29cb-c29c-41f8-9cfb-6379c167a596 {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:26:53.411659 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port e42a29cb-c29c-41f8-9cfb-6379c167a596, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=e42a29cb-c29c-41f8-9cfb-6379c167a596,segment=NetworkSegment(1e70bee6-dfc7-4037-8e59-6c6e25de8649),segment_id=1e70bee6-dfc7-4037-8e59-6c6e25de8649)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:26:53.415908 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:53.418181 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-9f728e85-a429-4786-a452-096b7c515647 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:53.512785 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=e42a29cb-c29c-41f8-9cfb-6379c167a596,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:53.517984 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:53.691859 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['e42a29cb-c29c-41f8-9cfb-6379c167a596'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:26:53.772623 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-449d387f-f39a-4ca9-91f5-e3a74c2b1f21 req-52f20a2c-e7ee-43a7-9fbb-359eed08611b tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:53.780127 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-449d387f-f39a-4ca9-91f5-e3a74c2b1f21 req-52f20a2c-e7ee-43a7-9fbb-359eed08611b tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 944 time: 0.1285770
May 31 16:26:53.859444 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-449d387f-f39a-4ca9-91f5-e3a74c2b1f21 req-73f894aa-71b2-4ff1-bdec-94f71b748f5c tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0757892
May 31 16:26:54.003454 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19a09bd4-eb15-4119-802c-12eeb0090a24 req-8916d1ad-960e-4016-9a0c-579bbfdd48cb tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:54.005599 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-19a09bd4-eb15-4119-802c-12eeb0090a24 req-8916d1ad-960e-4016-9a0c-579bbfdd48cb tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 945 time: 0.0937660
May 31 16:26:54.087862 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-19a09bd4-eb15-4119-802c-12eeb0090a24 req-8641f673-e59d-42d2-80cd-da432d140d28 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0743449
May 31 16:26:54.490470 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c7a047-82de-44c0-9e7d-ce736905e71c req-80c93c4a-6d71-4144-8492-0a573131fcaf tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:54.492012 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-48c7a047-82de-44c0-9e7d-ce736905e71c req-80c93c4a-6d71-4144-8492-0a573131fcaf tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.0880837
May 31 16:26:54.539051 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-48c7a047-82de-44c0-9e7d-ce736905e71c req-e7cb6c1a-c877-4606-94e1-e63bead8c7c4 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0412669
May 31 16:26:55.058475 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-261e767c-5137-47a1-9e66-5fdbb17c9785 req-5f0d95df-750f-4a14-993c-98528f42ccc8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:55.060121 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-261e767c-5137-47a1-9e66-5fdbb17c9785 req-5f0d95df-750f-4a14-993c-98528f42ccc8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 944 time: 0.0933805
May 31 16:26:55.140931 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-261e767c-5137-47a1-9e66-5fdbb17c9785 req-2dca23b9-e6df-42bf-b03a-d4288d57e036 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0735111
May 31 16:26:55.171075 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device e42a29cb-c29c-41f8-9cfb-6379c167a596 up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:26:55.261348 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning for port e42a29cb-c29c-41f8-9cfb-6379c167a596 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:26:55.266300 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port e42a29cb-c29c-41f8-9cfb-6379c167a596 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:26:55.266905 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:55.293990 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09b5f606-b839-4627-b5c5-b1430ff32cab req-a06d4483-d125-4963-8122-0292c30128c2 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:55.295476 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-09b5f606-b839-4627-b5c5-b1430ff32cab req-a06d4483-d125-4963-8122-0292c30128c2 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 945 time: 0.0880902
May 31 16:26:55.351805 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-09b5f606-b839-4627-b5c5-b1430ff32cab req-39d271ec-0a99-4a6f-89e7-450bcd568f6b tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0467379
May 31 16:26:55.443550 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:55.473656 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd9e580af-3588-40d6-9e2a-60c321af3d1e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e42a29cb-c29c-41f8-9cfb-6379c167a596'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:26:55.476149 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e36433bf-634d-4a77-8697-6918b29178bf" -d '{"events": [{"server_uuid": "d9e580af-3588-40d6-9e2a-60c321af3d1e", "name": "network-vif-plugged", "status": "completed", "tag": "e42a29cb-c29c-41f8-9cfb-6379c167a596"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:26:55.484681 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port e42a29cb-c29c-41f8-9cfb-6379c167a596, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=e42a29cb-c29c-41f8-9cfb-6379c167a596,segment=NetworkSegment(1e70bee6-dfc7-4037-8e59-6c6e25de8649),segment_id=1e70bee6-dfc7-4037-8e59-6c6e25de8649)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:26:55.490416 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:26:55.492459 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:26:55.544359 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:26:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-39ee3c82-3b70-489a-b2fa-dcce04314817 x-openstack-request-id: req-39ee3c82-3b70-489a-b2fa-dcce04314817 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:26:55.544664 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d9e580af-3588-40d6-9e2a-60c321af3d1e", "name": "network-vif-plugged", "status": "completed", "tag": "e42a29cb-c29c-41f8-9cfb-6379c167a596", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:26:55.544928 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-39ee3c82-3b70-489a-b2fa-dcce04314817 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:26:55.545318 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd9e580af-3588-40d6-9e2a-60c321af3d1e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e42a29cb-c29c-41f8-9cfb-6379c167a596', 'code': 200}
May 31 16:26:55.566405 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=e42a29cb-c29c-41f8-9cfb-6379c167a596,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:26:55.569759 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:26:55.852558 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-179c854e-6f60-4b10-a7be-b45bf3d6b17a req-6d710ccd-122a-44bc-ba07-abcf5e3bee6b tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:55.854235 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-179c854e-6f60-4b10-a7be-b45bf3d6b17a req-6d710ccd-122a-44bc-ba07-abcf5e3bee6b tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.2050352
May 31 16:26:55.899706 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-179c854e-6f60-4b10-a7be-b45bf3d6b17a req-bf91ede3-5ecd-4bb1-8ce7-a6b0deb05cb9 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0395732
May 31 16:26:56.347963 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3720be0c-bda2-4dfb-b388-17ec9b272600 req-731661e8-c316-47ea-85cf-410961c756d9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:56.349461 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3720be0c-bda2-4dfb-b388-17ec9b272600 req-731661e8-c316-47ea-85cf-410961c756d9 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 944 time: 0.0928445
May 31 16:26:56.399804 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3720be0c-bda2-4dfb-b388-17ec9b272600 req-8ada2a06-ba09-4c9a-83fc-43074764e9ca tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0444534
May 31 16:26:56.562912 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c14d2d6f-f49f-4531-9531-53343336bede req-3c43a506-a758-473b-b682-ef56aaae987b tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:56.564394 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c14d2d6f-f49f-4531-9531-53343336bede req-3c43a506-a758-473b-b682-ef56aaae987b tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.0833888
May 31 16:26:56.622058 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c14d2d6f-f49f-4531-9531-53343336bede req-8502c08c-13be-4217-bffb-ee32ac468856 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0508087
May 31 16:26:57.094361 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38129e9b-9915-497d-a2aa-7326c73b01b3 req-6aff6d7b-cb27-4cf5-ae9b-589920d7b787 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:57.096945 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-38129e9b-9915-497d-a2aa-7326c73b01b3 req-6aff6d7b-cb27-4cf5-ae9b-589920d7b787 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.0881853
May 31 16:26:57.143673 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-38129e9b-9915-497d-a2aa-7326c73b01b3 req-38b19b6e-1085-446a-8012-b3917cec3b2b tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0410085
May 31 16:26:57.598857 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecc3083e-3710-436c-ae86-0b6a521131d5 req-ee48184c-3655-4652-8f9b-f616d40374de tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:57.600298 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ecc3083e-3710-436c-ae86-0b6a521131d5 req-ee48184c-3655-4652-8f9b-f616d40374de tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 944 time: 0.0846579
May 31 16:26:57.649654 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ecc3083e-3710-436c-ae86-0b6a521131d5 req-e73efded-bacb-4672-9e71-2ac69c4b0635 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0429251
May 31 16:26:57.829414 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8b7a163-a15d-42c3-8bbc-bb9e296cf470 req-25bb7e5b-bf6b-4128-92c3-06b1740c924c tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:57.830973 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d8b7a163-a15d-42c3-8bbc-bb9e296cf470 req-25bb7e5b-bf6b-4128-92c3-06b1740c924c tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.0933907
May 31 16:26:57.880361 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d8b7a163-a15d-42c3-8bbc-bb9e296cf470 req-e0ea079b-4919-43f5-a705-549576892b9d tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0418594
May 31 16:26:58.336954 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2249c518-807b-407a-b84d-31149cbf5cfb req-7085c197-22ee-4be4-a26c-c0f87aae432d tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:58.338431 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2249c518-807b-407a-b84d-31149cbf5cfb req-7085c197-22ee-4be4-a26c-c0f87aae432d tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.0874257
May 31 16:26:58.396495 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2249c518-807b-407a-b84d-31149cbf5cfb req-2f71a769-c0b3-405e-b7a4-cd593ab79067 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0522888
May 31 16:26:58.855700 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5d87872-4285-4f0c-b6e5-7ef014954ae9 req-a7e6db92-f6d2-4098-9be9-f29f2540ac83 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:58.857566 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a5d87872-4285-4f0c-b6e5-7ef014954ae9 req-a7e6db92-f6d2-4098-9be9-f29f2540ac83 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 944 time: 0.0834248
May 31 16:26:58.915714 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a5d87872-4285-4f0c-b6e5-7ef014954ae9 req-2f36b378-900c-40bd-b17c-a7eba64ed8e4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0522168
May 31 16:26:59.100022 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2acbd95c-4288-4b2f-b08a-02d81323678a req-ea1b4d33-f9d8-457f-aa86-9ee22e419d07 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:59.101484 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2acbd95c-4288-4b2f-b08a-02d81323678a req-ea1b4d33-f9d8-457f-aa86-9ee22e419d07 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.0874424
May 31 16:26:59.158670 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2acbd95c-4288-4b2f-b08a-02d81323678a req-bacb4829-cb93-4745-ab5c-ae538506bd11 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0503275
May 31 16:26:59.603140 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ada1e85-9cf5-4df1-bb7f-376e549c7ce9 req-020e1c8f-55ec-4dd1-8a12-1de4dc3350f0 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:26:59.604611 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3ada1e85-9cf5-4df1-bb7f-376e549c7ce9 req-020e1c8f-55ec-4dd1-8a12-1de4dc3350f0 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.0964468
May 31 16:26:59.649997 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3ada1e85-9cf5-4df1-bb7f-376e549c7ce9 req-578febe7-da67-4de2-b358-24c6e734bf80 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0388870
May 31 16:27:00.137705 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77f6f3f8-10bb-4ca3-a1c2-defa06821b27 req-0daac715-e0be-4066-90c4-0a74be7d8994 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:00.139147 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-77f6f3f8-10bb-4ca3-a1c2-defa06821b27 req-0daac715-e0be-4066-90c4-0a74be7d8994 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 944 time: 0.0906448
May 31 16:27:00.187542 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-77f6f3f8-10bb-4ca3-a1c2-defa06821b27 req-b6e79f60-0de5-4d76-82a6-c221339655c8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0420163
May 31 16:27:00.357567 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43db8ff2-3cd0-49e2-b759-6aa9c5f06a47 req-bbd2451b-34cc-4316-bffd-3a94f1262b93 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:00.357567 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-43db8ff2-3cd0-49e2-b759-6aa9c5f06a47 req-bbd2451b-34cc-4316-bffd-3a94f1262b93 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.0855575
May 31 16:27:00.407016 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-43db8ff2-3cd0-49e2-b759-6aa9c5f06a47 req-67d9f0bf-7c51-4593-b497-be509d02f12c tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0416398
May 31 16:27:00.853417 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f243851-fe80-46fa-b57b-b5603e346689 req-ae555bf5-3e4f-4e82-aa7e-22816082c0de tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:00.855102 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5f243851-fe80-46fa-b57b-b5603e346689 req-ae555bf5-3e4f-4e82-aa7e-22816082c0de tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.0938127
May 31 16:27:00.901900 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5f243851-fe80-46fa-b57b-b5603e346689 req-d6facdfe-9c16-4115-a39f-d95150bc11eb tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0398097
May 31 16:27:01.386067 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd59f3ec-3ee5-4ed0-a0c2-c7b1c648212b req-07cb21f0-1fff-400e-ad56-6d7a80580e0c tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:01.387523 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-dd59f3ec-3ee5-4ed0-a0c2-c7b1c648212b req-07cb21f0-1fff-400e-ad56-6d7a80580e0c tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 944 time: 0.0839200
May 31 16:27:01.440211 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-dd59f3ec-3ee5-4ed0-a0c2-c7b1c648212b req-ddbbac43-b91b-4b8f-b81d-e1a59aad8577 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0459349
May 31 16:27:01.608769 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38d4b526-2721-4396-80f3-fd6d5972f42b req-29424e94-8db0-4bdf-94d9-12c44b7f35a8 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:01.610298 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-38d4b526-2721-4396-80f3-fd6d5972f42b req-29424e94-8db0-4bdf-94d9-12c44b7f35a8 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.0803561
May 31 16:27:01.666227 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-38d4b526-2721-4396-80f3-fd6d5972f42b req-1a6d4bbf-7795-4ea9-aa78-38497ddcc6ea tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0497706
May 31 16:27:02.098471 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-765b644a-1118-4ec1-99c7-239782f716d7 req-53bf7cf0-a45e-4e24-8d7a-8aafee5b00a0 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:02.100086 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-765b644a-1118-4ec1-99c7-239782f716d7 req-53bf7cf0-a45e-4e24-8d7a-8aafee5b00a0 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.0867167
May 31 16:27:02.147771 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-765b644a-1118-4ec1-99c7-239782f716d7 req-4405b26d-2dcf-4413-ab28-abdcf29c19dd tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0415461
May 31 16:27:02.637923 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43af435a-ebb9-462a-859a-3fba149d7a49 req-e257b1b8-09cf-4fff-a35e-591cd5a0d369 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:02.639291 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-43af435a-ebb9-462a-859a-3fba149d7a49 req-e257b1b8-09cf-4fff-a35e-591cd5a0d369 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 944 time: 0.0864940
May 31 16:27:02.696296 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-43af435a-ebb9-462a-859a-3fba149d7a49 req-06d3bb20-6e87-4964-931c-4cbafff630c5 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0504880
May 31 16:27:02.893376 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5d4a5f7-3b23-41bb-acaf-82437cd48fbf req-b0f02ca2-5ae1-48eb-bf83-336c84329ec6 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:02.894797 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f5d4a5f7-3b23-41bb-acaf-82437cd48fbf req-b0f02ca2-5ae1-48eb-bf83-336c84329ec6 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.0921614
May 31 16:27:02.941727 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f5d4a5f7-3b23-41bb-acaf-82437cd48fbf req-fe6f9f26-96d1-4c84-9882-808005db8ac5 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0413425
May 31 16:27:03.343443 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6e3dab2-4ebd-456a-bdf4-2bca736e5aac req-1783a39d-e617-4c82-9c23-3a2a045cdfd2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:03.344897 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e6e3dab2-4ebd-456a-bdf4-2bca736e5aac req-1783a39d-e617-4c82-9c23-3a2a045cdfd2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.0870106
May 31 16:27:03.398945 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e6e3dab2-4ebd-456a-bdf4-2bca736e5aac req-da3e771e-09f1-423d-a1a3-b50f457d4bf5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0482631
May 31 16:27:03.896402 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc014b33-45b0-4b6b-a721-aabf72865350 req-ef3891ec-0e4c-44a0-a193-ae2ba86cc3fa tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:03.897872 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cc014b33-45b0-4b6b-a721-aabf72865350 req-ef3891ec-0e4c-44a0-a193-ae2ba86cc3fa tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 944 time: 0.0865004
May 31 16:27:03.943039 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cc014b33-45b0-4b6b-a721-aabf72865350 req-d285b78e-4d72-4a51-9ab4-53dbae91abcc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0392673
May 31 16:27:04.141990 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a225263-e113-4594-ad8f-e5a3cc9f08aa req-c747b664-2409-4871-8b05-61f915226bf8 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:04.143586 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9a225263-e113-4594-ad8f-e5a3cc9f08aa req-c747b664-2409-4871-8b05-61f915226bf8 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.0846028
May 31 16:27:04.277603 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9a225263-e113-4594-ad8f-e5a3cc9f08aa req-cd747cc1-ed12-44f5-a21d-a2e8faea0552 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1282082
May 31 16:27:04.596811 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae127290-13c8-4744-a392-aa640af65e2d req-62cc851b-32a5-4f6b-97df-7bb07d8d2106 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:04.598644 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ae127290-13c8-4744-a392-aa640af65e2d req-62cc851b-32a5-4f6b-97df-7bb07d8d2106 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.0884764
May 31 16:27:04.652923 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ae127290-13c8-4744-a392-aa640af65e2d req-35e2c30b-89f4-4376-8775-44c7a467005f tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0476892
May 31 16:27:04.769312 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b1cd5d0-69a6-49de-b30c-c6fe394a3701 req-704e95ac-60c8-4778-a96d-c4823f8ad580 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:04.770771 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7b1cd5d0-69a6-49de-b30c-c6fe394a3701 req-704e95ac-60c8-4778-a96d-c4823f8ad580 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 1099 time: 0.0713170
May 31 16:27:04.811862 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7b1cd5d0-69a6-49de-b30c-c6fe394a3701 req-b019ab72-1c55-4bc3-8220-09d078c7b2bc service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0336139
May 31 16:27:05.007973 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-98c2c1f7-41be-470c-a9d7-b2d7a6ffa9a5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:05.138809 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e5d4c94-edd2-4b68-8018-049aa6cabbb6 req-37fa14d2-20f7-49c9-9083-612ccb4ffe3a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:05.140256 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7e5d4c94-edd2-4b68-8018-049aa6cabbb6 req-37fa14d2-20f7-49c9-9083-612ccb4ffe3a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 944 time: 0.0816462
May 31 16:27:05.189640 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7e5d4c94-edd2-4b68-8018-049aa6cabbb6 req-b685ffe1-6424-4bcd-8860-8efaa3988e7b tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0432930
May 31 16:27:05.208302 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 49427db6-0261-4969-89c1-47664fa8a818 details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:27:05.341125 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 49427db6-0261-4969-89c1-47664fa8a818, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=49427db6-0261-4969-89c1-47664fa8a818,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:27:05.355446 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': '49427db6-0261-4969-89c1-47664fa8a818', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'port_id': '49427db6-0261-4969-89c1-47664fa8a818', 'mac_address': 'fa:16:3e:ca:d5:90', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 806, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:27:05.414377 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:05.432031 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 49427db6-0261-4969-89c1-47664fa8a818 {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:27:05.447195 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 49427db6-0261-4969-89c1-47664fa8a818, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=49427db6-0261-4969-89c1-47664fa8a818,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:27:05.452225 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:05.454260 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:05.467545 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24b25b1f-b191-4480-8b84-d8f8b2c925cb req-004aeecc-9f28-4a4e-9e0b-abf2adca97d4 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:05.468994 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-24b25b1f-b191-4480-8b84-d8f8b2c925cb req-004aeecc-9f28-4a4e-9e0b-abf2adca97d4 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.0840571
May 31 16:27:05.520995 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-24b25b1f-b191-4480-8b84-d8f8b2c925cb req-5bff597b-eb1d-4e64-9b1a-4cd7b356135e tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0441256
May 31 16:27:05.522825 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=49427db6-0261-4969-89c1-47664fa8a818,revision_number=9']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:05.525912 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:05.704635 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['49427db6-0261-4969-89c1-47664fa8a818'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:27:05.845067 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecc4a007-da8e-4209-a973-a99ca002938d req-7cc3f809-ae21-4689-bd11-ae45e7eca348 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:05.847308 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ecc4a007-da8e-4209-a973-a99ca002938d req-7cc3f809-ae21-4689-bd11-ae45e7eca348 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.0886459
May 31 16:27:05.893339 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ecc4a007-da8e-4209-a973-a99ca002938d req-598f3ed5-93da-40b6-9f5f-75db456b354a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0396123
May 31 16:27:06.286023 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e510c7e-b16a-492f-904b-98aeeb3e7638 req-ecdf7544-eb5d-4897-b5f3-ad2c439eb0c5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:06.287496 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4e510c7e-b16a-492f-904b-98aeeb3e7638 req-ecdf7544-eb5d-4897-b5f3-ad2c439eb0c5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.1384680
May 31 16:27:06.321404 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12258b52-7adb-49a2-a003-a307f4904a8a req-52e8e495-18cd-45df-b3f7-2f9135e22d46 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:06.322901 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-12258b52-7adb-49a2-a003-a307f4904a8a req-52e8e495-18cd-45df-b3f7-2f9135e22d46 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=a56002dfed61485aa4d9e237932e1abf&device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 1098 time: 0.1198378
May 31 16:27:06.409208 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4e510c7e-b16a-492f-904b-98aeeb3e7638 req-d253acfe-e177-4e0d-b720-121ba8112e75 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1146700
May 31 16:27:06.528299 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12258b52-7adb-49a2-a003-a307f4904a8a req-5c15fe06-fd38-4056-b12b-45ec3d33a282 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:06.529709 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-12258b52-7adb-49a2-a003-a307f4904a8a req-5c15fe06-fd38-4056-b12b-45ec3d33a282 service neutron] 10.222.0.63 "GET /v2.0/networks?id=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 HTTP/1.1" status: 200  len: 911 time: 0.1697791
May 31 16:27:06.538045 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10a865d8-5170-42b8-91f5-36284742c274 req-af16e772-c968-4fb3-9031-dcf5990311ac tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:06.539404 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-10a865d8-5170-42b8-91f5-36284742c274 req-af16e772-c968-4fb3-9031-dcf5990311ac tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 945 time: 0.2222185
May 31 16:27:06.708163 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-10a865d8-5170-42b8-91f5-36284742c274 req-5fa9a3fa-fb10-419f-9793-cf341b9df901 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1203449
May 31 16:27:06.712831 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-12258b52-7adb-49a2-a003-a307f4904a8a req-e52bc349-33b2-4d3e-9be3-ad4319fe2a9d service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=cd88a910-8740-4a3f-aafb-41a504f611ee HTTP/1.1" status: 200  len: 1000 time: 0.1725190
May 31 16:27:06.793716 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12258b52-7adb-49a2-a003-a307f4904a8a req-2862eab2-7206-4758-ad48-ce5ddec0dda0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:06.795213 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-12258b52-7adb-49a2-a003-a307f4904a8a req-2862eab2-7206-4758-ad48-ce5ddec0dda0 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=6489943b-1236-4d7c-80a7-58ef5aedf09d HTTP/1.1" status: 200  len: 849 time: 0.0745978
May 31 16:27:06.803899 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09e31795-6463-40bd-a104-bba04d966273 req-d5bf9c92-4c89-42cc-b11a-1e4432550e46 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:06.805256 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-09e31795-6463-40bd-a104-bba04d966273 req-d5bf9c92-4c89-42cc-b11a-1e4432550e46 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.1647708
May 31 16:27:06.895356 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-09e31795-6463-40bd-a104-bba04d966273 req-6133f7d9-e30e-4970-bad7-54035dd20a38 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0599403
May 31 16:27:06.912153 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12258b52-7adb-49a2-a003-a307f4904a8a req-f8df8a3d-fb48-48a2-bd16-63a6cc846753 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:06.913599 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-12258b52-7adb-49a2-a003-a307f4904a8a req-f8df8a3d-fb48-48a2-bd16-63a6cc846753 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1074705
May 31 16:27:07.105757 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-12258b52-7adb-49a2-a003-a307f4904a8a req-ea26208c-9272-46e0-a12e-b25818fc02f8 service neutron] 10.222.0.63 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1846325
May 31 16:27:07.143574 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec834907-c645-436d-ada1-61c51f020cbb req-deb20b58-0113-4fc2-aa83-c9a2be33c2ad tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:07.144983 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ec834907-c645-436d-ada1-61c51f020cbb req-deb20b58-0113-4fc2-aa83-c9a2be33c2ad tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.1412184
May 31 16:27:07.213067 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 49427db6-0261-4969-89c1-47664fa8a818 up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:27:07.284090 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port 49427db6-0261-4969-89c1-47664fa8a818 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:27:07.284599 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:07.368673 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ec834907-c645-436d-ada1-61c51f020cbb req-0a2ce51b-6a63-4ce0-9d9b-c048b32a1a1d tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1796062
May 31 16:27:07.390357 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-12258b52-7adb-49a2-a003-a307f4904a8a req-ce847e29-456b-4954-8475-5dd030c8f37d service neutron] 10.222.0.63 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2782488
May 31 16:27:07.391396 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 37008) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:27:07.407115 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:07.435934 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '61f2d7a8-c7cd-4a2d-9a17-4654f91ad264', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '49427db6-0261-4969-89c1-47664fa8a818'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:27:07.438369 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eeb1470d-7998-436f-8b36-e07d490f6fa1" -d '{"events": [{"server_uuid": "61f2d7a8-c7cd-4a2d-9a17-4654f91ad264", "name": "network-vif-plugged", "status": "completed", "tag": "49427db6-0261-4969-89c1-47664fa8a818"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:27:07.446650 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 49427db6-0261-4969-89c1-47664fa8a818, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=49427db6-0261-4969-89c1-47664fa8a818,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:27:07.458510 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:07.460537 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:07.506623 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:27:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4f71bcac-7b5c-495f-859c-7dac96ee4450 x-openstack-request-id: req-4f71bcac-7b5c-495f-859c-7dac96ee4450 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:27:07.506915 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "61f2d7a8-c7cd-4a2d-9a17-4654f91ad264", "name": "network-vif-plugged", "status": "completed", "tag": "49427db6-0261-4969-89c1-47664fa8a818", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:27:07.507170 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-4f71bcac-7b5c-495f-859c-7dac96ee4450 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:27:07.507557 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '61f2d7a8-c7cd-4a2d-9a17-4654f91ad264', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '49427db6-0261-4969-89c1-47664fa8a818', 'code': 200}
May 31 16:27:07.542723 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=49427db6-0261-4969-89c1-47664fa8a818,revision_number=10']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:07.545507 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:07.660859 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b6bbbea3-1037-4723-a246-f847cdbf8e85 tempest-TestShelveInstance-1381608133 tempest-TestShelveInstance-1381608133-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:07.661472 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-b6bbbea3-1037-4723-a246-f847cdbf8e85 tempest-TestShelveInstance-1381608133 tempest-TestShelveInstance-1381608133-project-admin] Synchronizing usage tracker for tenant:aaf741cd215644308245542578883a8a on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:27:07.672414 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f08ee01-ae80-47e6-9a59-b0f5253857c3 req-bfdabae8-7e86-48e4-a6fb-eab429a02caf tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:07.674505 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6f08ee01-ae80-47e6-9a59-b0f5253857c3 req-bfdabae8-7e86-48e4-a6fb-eab429a02caf tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.1168201
May 31 16:27:07.740567 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-b6bbbea3-1037-4723-a246-f847cdbf8e85 tempest-TestShelveInstance-1381608133 tempest-TestShelveInstance-1381608133-project-admin] Unset dirty status for tenant:aaf741cd215644308245542578883a8a on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:27:07.741796 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-b6bbbea3-1037-4723-a246-f847cdbf8e85 tempest-TestShelveInstance-1381608133 tempest-TestShelveInstance-1381608133-project-admin] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 1094 time: 0.3494072
May 31 16:27:07.744760 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 37020) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:27:07.752472 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Request body: {'floatingip': {'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'port_id': 'e42a29cb-c29c-41f8-9cfb-6379c167a596', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'fixed_ip_address': '172.20.0.13'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:27:07.769609 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:27:07.777545 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Usage tracker for resource:floatingip and tenant:ff0bbba58394409987a388bb38868b4e is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:27:07.780028 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6f08ee01-ae80-47e6-9a59-b0f5253857c3 req-6b72724a-e4f7-4678-aedb-7627cd462bb0 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0989053
May 31 16:27:07.789815 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:27:07.796748 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:27:07.797144 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b16c486-2461-4c8f-9b4e-33b8ce9dc980 req-3a3da47c-7889-430c-be00-6c21f7f7eedf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:07.798713 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1b16c486-2461-4c8f-9b4e-33b8ce9dc980 req-3a3da47c-7889-430c-be00-6c21f7f7eedf service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 1100 time: 0.1019888
May 31 16:27:07.813278 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for floatingip, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:07.927303 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:07.968053 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1b16c486-2461-4c8f-9b4e-33b8ce9dc980 req-9ab88ee3-9a13-4533-9b74-6f5e628ba214 service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1606336
May 31 16:27:08.045234 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0340448a-2d80-479f-b4bc-b01e66377325 req-30d92c63-1458-4b50-9464-7d00bf605d4a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:08.046774 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0340448a-2d80-479f-b4bc-b01e66377325 req-30d92c63-1458-4b50-9464-7d00bf605d4a tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 947 time: 0.1860189
May 31 16:27:08.048291 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:08.096070 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0340448a-2d80-479f-b4bc-b01e66377325 req-13e80571-25a5-4d4d-87bb-6f3e8a06f4bd tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0424366
May 31 16:27:08.194341 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Allocated IP 172.27.0.87 (00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c/96709d85-d0fe-4cf8-b232-eaf6b143ebe6/5a028dac-261a-4424-8089-c4820c3cf050) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:27:08.217005 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f20dd021-277f-44c8-a227-9fbc586e3034 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:08.342447 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:08.372280 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:08.377618 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d18be2e2-f8d1-40ad-b4fc-1668c1d8d145 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:08.440021 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:27:08.442904 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:27:08.446577 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:27:08.489143 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Pushing event updated for resources: {'Port': ['ID=5a028dac-261a-4424-8089-c4820c3cf050,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:08.501291 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:08.501891 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:08.502712 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:08.503081 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:08.503442 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:08.503804 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:08.504166 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:08.504523 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:08.504989 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:08.505355 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:08.505735 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:08.506092 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:08.510890 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:08.882248 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:08.974115 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:09.021886 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b0cd689-f73d-4d02-a866-6db897001222 req-41b541c9-9c03-4907-97d4-a3c8025a975f tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:09.023551 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6b0cd689-f73d-4d02-a866-6db897001222 req-41b541c9-9c03-4907-97d4-a3c8025a975f tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.1255231
May 31 16:27:09.079146 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6b0cd689-f73d-4d02-a866-6db897001222 req-c43e4f66-4b4f-42fe-9240-588ef1ddddaf tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0481515
May 31 16:27:09.168821 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:09.217801 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for port, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:09.222934 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14337082'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:09.227993 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:09.304236 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-131618e1-19c7-4a09-9293-913409bbdcea req-daff83d9-733b-4d3a-ad4e-447aa4389856 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:09.305944 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-131618e1-19c7-4a09-9293-913409bbdcea req-daff83d9-733b-4d3a-ad4e-447aa4389856 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 947 time: 0.0883782
May 31 16:27:09.354202 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-131618e1-19c7-4a09-9293-913409bbdcea req-91f3d721-c547-4e0d-ad8e-c23cd11aad34 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0416882
May 31 16:27:09.432790 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Pushing event updated for resources: {'Port': ['ID=5a028dac-261a-4424-8089-c4820c3cf050,revision_number=2']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:09.436812 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:09.440032 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16621821'] for floatingip, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:09.615313 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.l3_db [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Floating IP cb7b2aba-d9dd-40bd-a8db-2affe7258aae associated. External IP: 172.27.0.87, port: e42a29cb-c29c-41f8-9cfb-6379c167a596.
May 31 16:27:09.968599 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Router 9e698298-b838-4dbb-939c-c84fb0148003 has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91763) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:27:10.150358 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:27:10.160472 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1ad1bc4-84a0-4861-bf14-2e48282a537a None None] Sync routers for ids ['9e698298-b838-4dbb-939c-c84fb0148003'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:27:10.169869 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1ad1bc4-84a0-4861-bf14-2e48282a537a None None] Routers {'9e698298-b838-4dbb-939c-c84fb0148003'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:27:10.170525 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-c1ad1bc4-84a0-4861-bf14-2e48282a537a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f142641d100>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:27:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['9e698298-b838-4dbb-939c-c84fb0148003'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:27:10.176683 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for floatingip, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:10.232835 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 2.4851673
May 31 16:27:10.233316 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd9e580af-3588-40d6-9e2a-60c321af3d1e', 'tag': 'e42a29cb-c29c-41f8-9cfb-6379c167a596'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:27:10.235613 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7891fa24-5d26-4b09-b8be-bf9724aab7de" -d '{"events": [{"name": "network-changed", "server_uuid": "d9e580af-3588-40d6-9e2a-60c321af3d1e", "tag": "e42a29cb-c29c-41f8-9cfb-6379c167a596"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:27:10.277587 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:27:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-29af0ad6-562e-4aa2-baa6-6829dc882a7b x-openstack-request-id: req-29af0ad6-562e-4aa2-baa6-6829dc882a7b {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:27:10.277922 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d9e580af-3588-40d6-9e2a-60c321af3d1e", "tag": "e42a29cb-c29c-41f8-9cfb-6379c167a596", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:27:10.278214 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-29af0ad6-562e-4aa2-baa6-6829dc882a7b {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:27:10.278645 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd9e580af-3588-40d6-9e2a-60c321af3d1e', 'tag': 'e42a29cb-c29c-41f8-9cfb-6379c167a596', 'status': 'completed', 'code': 200}
May 31 16:27:10.357748 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-c1ad1bc4-84a0-4861-bf14-2e48282a537a None None] Set router 9e698298-b838-4dbb-939c-c84fb0148003 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:27:10.381986 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7891fa24-5d26-4b09-b8be-bf9724aab7de req-c07822e7-5581-4499-b08c-ba315470ceea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:10.383463 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7891fa24-5d26-4b09-b8be-bf9724aab7de req-c07822e7-5581-4499-b08c-ba315470ceea service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=ff0bbba58394409987a388bb38868b4e&device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 1099 time: 0.0769660
May 31 16:27:10.577195 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7891fa24-5d26-4b09-b8be-bf9724aab7de req-e619f98d-2129-4bb4-9299-3ab57c99f4ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:10.578691 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7891fa24-5d26-4b09-b8be-bf9724aab7de req-e619f98d-2129-4bb4-9299-3ab57c99f4ef service neutron] 10.222.0.63 "GET /v2.0/networks?id=0e202b3d-d60d-481f-bf3a-e31943668c98 HTTP/1.1" status: 200  len: 909 time: 0.1891382
May 31 16:27:10.670346 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2363f204-3407-40a5-b77a-1940398f1865 req-442e508d-b888-49da-9174-4855dbc528c2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:10.671824 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2363f204-3407-40a5-b77a-1940398f1865 req-442e508d-b888-49da-9174-4855dbc528c2 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 947 time: 0.1971617
May 31 16:27:10.719458 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-c1ad1bc4-84a0-4861-bf14-2e48282a537a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f142641d100>, [{'id': '9e698298-b838-4dbb-939c-c84fb0148003', 'name': 'tempest-TestShelveInstance-844578684-router', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:05Z', 'updated_at': '2021-05-31T16:26:11Z', 'revision_number': 4, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'gw_port': {'id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:06:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_gateway', 'standard_attr_id': 550, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:07Z', 'updated_at': '2021-05-31T16:26:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': 'cb7b2aba-d9dd-40bd-a8db-2affe7258aae', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'floating_ip_address': '172.27.0.87', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'port_id': 'e42a29cb-c29c-41f8-9cfb-6379c167a596', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 575, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98', 'mac_address': 'fa:16:3e:0a:33:5d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9e580af-3588-40d6-9e2a-60c321af3d1e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:27:08Z', 'updated_at': '2021-05-31T16:27:08Z', 'revision_number': 0, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7fc65e68-76ee-48bf-8bb1-c3e5453fb94c', 'name': '', 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'mac_address': 'fa:16:3e:c5:53:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_interface', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '20f6caad-2e13-4108-af8f-f9c2336ccde2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:10Z', 'updated_at': '2021-05-31T16:26:16Z', 'revision_number': 5, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'subnets': [{'id': '20f6caad-2e13-4108-af8f-f9c2336ccde2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:27:10.723696 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1ad1bc4-84a0-4861-bf14-2e48282a537a None None] Checking router: 9e698298-b838-4dbb-939c-c84fb0148003 for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:27:10.730062 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7891fa24-5d26-4b09-b8be-bf9724aab7de req-baa85fac-ed2a-4aea-a64e-0c44853f535a service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=e42a29cb-c29c-41f8-9cfb-6379c167a596 HTTP/1.1" status: 200  len: 999 time: 0.1439624
May 31 16:27:10.732406 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1ad1bc4-84a0-4861-bf14-2e48282a537a None None] Routers {'9e698298-b838-4dbb-939c-c84fb0148003'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:27:10.733020 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-c1ad1bc4-84a0-4861-bf14-2e48282a537a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f142641d100>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:27:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['9e698298-b838-4dbb-939c-c84fb0148003'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:27:10.770871 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2363f204-3407-40a5-b77a-1940398f1865 req-2feb64e9-929b-4c26-9bf8-00d93d9783f6 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0854249
May 31 16:27:10.809178 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7891fa24-5d26-4b09-b8be-bf9724aab7de req-7a2dd5fb-db90-4d40-a8a6-82ed8c2c87bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:10.811958 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7891fa24-5d26-4b09-b8be-bf9724aab7de req-7a2dd5fb-db90-4d40-a8a6-82ed8c2c87bc service neutron] 10.222.0.63 "GET /v2.0/subnets?id=20f6caad-2e13-4108-af8f-f9c2336ccde2 HTTP/1.1" status: 200  len: 847 time: 0.0733559
May 31 16:27:10.890916 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7891fa24-5d26-4b09-b8be-bf9724aab7de req-8c83dab7-f3c4-465e-8ae6-0335317aa269 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:10.892549 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7891fa24-5d26-4b09-b8be-bf9724aab7de req-8c83dab7-f3c4-465e-8ae6-0335317aa269 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=0e202b3d-d60d-481f-bf3a-e31943668c98&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0747683
May 31 16:27:10.953722 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:10.972685 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-c1ad1bc4-84a0-4861-bf14-2e48282a537a None None] Set router 9e698298-b838-4dbb-939c-c84fb0148003 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:27:11.035546 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7891fa24-5d26-4b09-b8be-bf9724aab7de req-83eb9f38-cec9-4249-a7bd-b6f922229c60 service neutron] 10.222.0.63 "GET /v2.0/networks/0e202b3d-d60d-481f-bf3a-e31943668c98?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1338086
May 31 16:27:11.172579 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7891fa24-5d26-4b09-b8be-bf9724aab7de req-a360c787-5866-4d2f-ac89-22413580ee32 service neutron] 10.222.0.63 "GET /v2.0/networks/0e202b3d-d60d-481f-bf3a-e31943668c98?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1302397
May 31 16:27:11.332526 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-c1ad1bc4-84a0-4861-bf14-2e48282a537a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f142641d100>, [{'id': '9e698298-b838-4dbb-939c-c84fb0148003', 'name': 'tempest-TestShelveInstance-844578684-router', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:05Z', 'updated_at': '2021-05-31T16:26:11Z', 'revision_number': 4, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'gw_port': {'id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:06:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_gateway', 'standard_attr_id': 550, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:07Z', 'updated_at': '2021-05-31T16:26:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': 'cb7b2aba-d9dd-40bd-a8db-2affe7258aae', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'floating_ip_address': '172.27.0.87', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'port_id': 'e42a29cb-c29c-41f8-9cfb-6379c167a596', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 575, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98', 'mac_address': 'fa:16:3e:0a:33:5d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9e580af-3588-40d6-9e2a-60c321af3d1e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:27:08Z', 'updated_at': '2021-05-31T16:27:08Z', 'revision_number': 0, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7fc65e68-76ee-48bf-8bb1-c3e5453fb94c', 'name': '', 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'mac_address': 'fa:16:3e:c5:53:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_interface', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '20f6caad-2e13-4108-af8f-f9c2336ccde2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:10Z', 'updated_at': '2021-05-31T16:26:16Z', 'revision_number': 5, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'subnets': [{'id': '20f6caad-2e13-4108-af8f-f9c2336ccde2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:27:11.336583 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1ad1bc4-84a0-4861-bf14-2e48282a537a None None] The sync data for ids ['9e698298-b838-4dbb-939c-c84fb0148003'] in dv-cinder-793814-1-iscsi is: [{'id': '9e698298-b838-4dbb-939c-c84fb0148003', 'name': 'tempest-TestShelveInstance-844578684-router', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:05Z', 'updated_at': '2021-05-31T16:26:11Z', 'revision_number': 4, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'gw_port': {'id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:06:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_gateway', 'standard_attr_id': 550, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:07Z', 'updated_at': '2021-05-31T16:26:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': 'cb7b2aba-d9dd-40bd-a8db-2affe7258aae', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'floating_ip_address': '172.27.0.87', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'port_id': 'e42a29cb-c29c-41f8-9cfb-6379c167a596', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 575, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98', 'mac_address': 'fa:16:3e:0a:33:5d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9e580af-3588-40d6-9e2a-60c321af3d1e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:27:08Z', 'updated_at': '2021-05-31T16:27:08Z', 'revision_number': 0, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7fc65e68-76ee-48bf-8bb1-c3e5453fb94c', 'name': '', 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'mac_address': 'fa:16:3e:c5:53:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_interface', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '20f6caad-2e13-4108-af8f-f9c2336ccde2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:10Z', 'updated_at': '2021-05-31T16:26:16Z', 'revision_number': 5, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'subnets': [{'id': '20f6caad-2e13-4108-af8f-f9c2336ccde2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:27:11.506595 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-edbae82b-c135-49bf-9bcf-d395651a603d None None] New status for floating IP cb7b2aba-d9dd-40bd-a8db-2affe7258aae: ACTIVE {{(pid=91766) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 31 16:27:19.682113 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:22.170572 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:27:35.010186 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-eff38ca0-06f6-4f14-9762-2c0512164253 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:37.895976 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:38.218548 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-ab7c4f2e-9373-4ebd-9b6a-f80c469a5068 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:39.172428 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:40.878401 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:44.516898 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eadc057-8558-407c-9200-7466b575b908 req-eda8849f-8e78-4622-8a2b-72a32f69219b tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:44.518294 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9eadc057-8558-407c-9200-7466b575b908 req-eda8849f-8e78-4622-8a2b-72a32f69219b tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 947 time: 0.0892818
May 31 16:27:44.562792 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9eadc057-8558-407c-9200-7466b575b908 req-64149d54-97e2-463f-ac14-c91ff6073894 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0385823
May 31 16:27:45.446672 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cab3243f-a934-481b-b6d6-1240ee7c7524 req-7ef836a2-6fbf-494c-ab2b-34e30b171875 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:45.448099 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cab3243f-a934-481b-b6d6-1240ee7c7524 req-7ef836a2-6fbf-494c-ab2b-34e30b171875 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.0834038
May 31 16:27:45.497226 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cab3243f-a934-481b-b6d6-1240ee7c7524 req-64e57f5e-8349-4915-b39e-836ef46a7a64 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0434489
May 31 16:27:45.855007 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16add9f2-ccba-4128-910d-672b0e849dd4 req-0d32c0ef-e1c1-4616-89bd-5b0f9f2166f3 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:45.856455 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-16add9f2-ccba-4128-910d-672b0e849dd4 req-0d32c0ef-e1c1-4616-89bd-5b0f9f2166f3 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 947 time: 0.1826899
May 31 16:27:45.902342 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-16add9f2-ccba-4128-910d-672b0e849dd4 req-710f2c5c-5f6e-4c92-bde5-977a48054551 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0401781
May 31 16:27:46.284140 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02511435-08a9-4ce7-af9b-a35da09711e8 req-8a6bcf70-9988-4431-bbf1-becf93bb8680 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:46.285457 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-02511435-08a9-4ce7-af9b-a35da09711e8 req-8a6bcf70-9988-4431-bbf1-becf93bb8680 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.63 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 947 time: 0.0806127
May 31 16:27:46.423311 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [req-02511435-08a9-4ce7-af9b-a35da09711e8 req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Deleting port 49427db6-0261-4969-89c1-47664fa8a818 {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:27:46.423650 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-02511435-08a9-4ce7-af9b-a35da09711e8 req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:46.556835 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-02511435-08a9-4ce7-af9b-a35da09711e8 req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] For port 49427db6-0261-4969-89c1-47664fa8a818, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=49427db6-0261-4969-89c1-47664fa8a818,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:27:46.557193 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-02511435-08a9-4ce7-af9b-a35da09711e8 req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:46.807780 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65b00067-2353-4b1f-aba4-78739c5aef78 req-c0eee06c-3b7b-40a1-b263-bed4469f657a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:46.809217 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-65b00067-2353-4b1f-aba4-78739c5aef78 req-c0eee06c-3b7b-40a1-b263-bed4469f657a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.1908834
May 31 16:27:46.946020 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-02511435-08a9-4ce7-af9b-a35da09711e8 req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:46.946587 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-02511435-08a9-4ce7-af9b-a35da09711e8 req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16621821'] for floatingip, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:46.946703 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.db.l3_db [req-02511435-08a9-4ce7-af9b-a35da09711e8 req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Floating IP 06133069-c955-49dc-b4bc-d10700328eb1 disassociated. External IP: 172.27.0.216, port: 49427db6-0261-4969-89c1-47664fa8a818.
May 31 16:27:46.947030 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [req-02511435-08a9-4ce7-af9b-a35da09711e8 req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Calling delete_port for 49427db6-0261-4969-89c1-47664fa8a818 owned by compute:nova {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:27:46.951674 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-65b00067-2353-4b1f-aba4-78739c5aef78 req-ad738cab-e1f1-4b4f-a991-b9d0dc98e628 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0813651
May 31 16:27:47.114704 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-02511435-08a9-4ce7-af9b-a35da09711e8 req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:47.120528 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:47.172415 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Pushing event deleted for resources: {'Port': ['ID=49427db6-0261-4969-89c1-47664fa8a818,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:47.183514 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:47.183900 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:47.184275 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:47.185350 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:47.185350 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:47.185617 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:47.186002 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:47.186373 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:47.187165 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:47.187165 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:47.187482 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:47.187822 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:47.247311 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:47.283725 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b83f32f-b93f-4756-bd96-9f4863e1b554 req-23573c03-97c7-4717-94de-23b8fe0bec4e tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:47.285185 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9b83f32f-b93f-4756-bd96-9f4863e1b554 req-23573c03-97c7-4717-94de-23b8fe0bec4e tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/ports?device_id=61f2d7a8-c7cd-4a2d-9a17-4654f91ad264 HTTP/1.1" status: 200  len: 947 time: 0.2566569
May 31 16:27:47.410253 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9b83f32f-b93f-4756-bd96-9f4863e1b554 req-f5cf1018-eb13-4304-8a0f-8607a773d25d tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups?id=8fbc8cfd-84c0-4533-a8cc-20e7833b04de&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0690923
May 31 16:27:47.420114 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.l3_agent_scheduler [req-02511435-08a9-4ce7-af9b-a35da09711e8 req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Router 8471b167-8540-4806-9932-e05fcb75a12b has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91764) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:27:47.716453 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-02511435-08a9-4ce7-af9b-a35da09711e8 req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91764) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:27:47.726043 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0785dd86-de40-4355-9ea9-7db7cdd505da None None] Sync routers for ids ['8471b167-8540-4806-9932-e05fcb75a12b'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:27:47.736053 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0785dd86-de40-4355-9ea9-7db7cdd505da None None] Routers {'8471b167-8540-4806-9932-e05fcb75a12b'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:27:47.736774 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-0785dd86-de40-4355-9ea9-7db7cdd505da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426106fa0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:27:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['8471b167-8540-4806-9932-e05fcb75a12b'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:27:47.791448 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [req-02511435-08a9-4ce7-af9b-a35da09711e8 req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] No DVR routers for this DVR port 49427db6-0261-4969-89c1-47664fa8a818 on host hv-cinder-79381 {{(pid=91764) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:27:47.794032 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-02511435-08a9-4ce7-af9b-a35da09711e8 req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:47.796701 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '61f2d7a8-c7cd-4a2d-9a17-4654f91ad264', 'name': 'network-vif-deleted', 'tag': '49427db6-0261-4969-89c1-47664fa8a818'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:27:47.798987 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-196031c6-e8eb-4b87-a6d3-46a77d8adebe" -d '{"events": [{"server_uuid": "61f2d7a8-c7cd-4a2d-9a17-4654f91ad264", "name": "network-vif-deleted", "tag": "49427db6-0261-4969-89c1-47664fa8a818"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:27:47.809298 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-02511435-08a9-4ce7-af9b-a35da09711e8 req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.63 "DELETE /v2.0/ports/49427db6-0261-4969-89c1-47664fa8a818 HTTP/1.1" status: 204  len: 173 time: 1.5161548
May 31 16:27:47.889716 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:27:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3985adcd-a419-4c7c-b282-e521272f7e9d x-openstack-request-id: req-3985adcd-a419-4c7c-b282-e521272f7e9d {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:27:47.890073 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "61f2d7a8-c7cd-4a2d-9a17-4654f91ad264", "name": "network-vif-deleted", "tag": "49427db6-0261-4969-89c1-47664fa8a818", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:27:47.890366 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-3985adcd-a419-4c7c-b282-e521272f7e9d {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:27:47.890866 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '61f2d7a8-c7cd-4a2d-9a17-4654f91ad264', 'name': 'network-vif-deleted', 'tag': '49427db6-0261-4969-89c1-47664fa8a818', 'status': 'completed', 'code': 200}
May 31 16:27:47.937154 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-0785dd86-de40-4355-9ea9-7db7cdd505da None None] Set router 8471b167-8540-4806-9932-e05fcb75a12b gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:27:47.948125 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0571c0f6-f389-4618-80d7-2bc5009724b3 req-eff027c0-3775-4b26-8ef9-7022076d1847 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:47.949614 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0571c0f6-f389-4618-80d7-2bc5009724b3 req-eff027c0-3775-4b26-8ef9-7022076d1847 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.63 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.1081338
May 31 16:27:48.169330 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [req-0571c0f6-f389-4618-80d7-2bc5009724b3 req-edf07e18-86ac-4ab7-b82b-fd7b216bdfd2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Deleting port cd88a910-8740-4a3f-aafb-41a504f611ee {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:27:48.169714 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-0571c0f6-f389-4618-80d7-2bc5009724b3 req-edf07e18-86ac-4ab7-b82b-fd7b216bdfd2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:48.197737 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-139587d7-8e2c-477c-9cff-b182844ebbad req-404cc34a-2d99-43c9-b101-06e085288f31 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:48.198901 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-139587d7-8e2c-477c-9cff-b182844ebbad req-404cc34a-2d99-43c9-b101-06e085288f31 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 945 time: 0.1306856
May 31 16:27:48.270500 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-0785dd86-de40-4355-9ea9-7db7cdd505da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426106fa0>, [{'id': '8471b167-8540-4806-9932-e05fcb75a12b', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:55Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '12203182731d4a61acb7fc5914aef425', 'gw_port': {'id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:83:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:19:56Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': 'db126eb4-e252-4765-86f1-09d3f20549df', 'name': '', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'mac_address': 'fa:16:3e:63:bd:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:04Z', 'updated_at': '2021-05-31T16:20:20Z', 'revision_number': 5, 'project_id': '12203182731d4a61acb7fc5914aef425', 'subnets': [{'id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:27:48.274743 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0785dd86-de40-4355-9ea9-7db7cdd505da None None] Checking router: 8471b167-8540-4806-9932-e05fcb75a12b for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:27:48.283431 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0785dd86-de40-4355-9ea9-7db7cdd505da None None] Routers {'8471b167-8540-4806-9932-e05fcb75a12b'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:27:48.284207 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-0785dd86-de40-4355-9ea9-7db7cdd505da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426106fa0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:27:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['8471b167-8540-4806-9932-e05fcb75a12b'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:27:48.328161 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-139587d7-8e2c-477c-9cff-b182844ebbad req-a1038005-f7b4-438a-b336-7481d40a994d tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0795085
May 31 16:27:48.366154 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-0571c0f6-f389-4618-80d7-2bc5009724b3 req-edf07e18-86ac-4ab7-b82b-fd7b216bdfd2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] For port cd88a910-8740-4a3f-aafb-41a504f611ee, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=cd88a910-8740-4a3f-aafb-41a504f611ee,segment=NetworkSegment(1974822a-78ff-4607-935a-c9f5ba4a898d),segment_id=1974822a-78ff-4607-935a-c9f5ba4a898d)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:27:48.366584 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-0571c0f6-f389-4618-80d7-2bc5009724b3 req-edf07e18-86ac-4ab7-b82b-fd7b216bdfd2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:48.529884 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-0785dd86-de40-4355-9ea9-7db7cdd505da None None] Set router 8471b167-8540-4806-9932-e05fcb75a12b gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:27:48.550345 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 37126) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:27:48.630929 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d3c2ac47-97f4-443d-abd1-a2d9898e083b tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:48.665106 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d3c2ac47-97f4-443d-abd1-a2d9898e083b tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:48.692415 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-0571c0f6-f389-4618-80d7-2bc5009724b3 req-edf07e18-86ac-4ab7-b82b-fd7b216bdfd2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:48.693302 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-0571c0f6-f389-4618-80d7-2bc5009724b3 req-edf07e18-86ac-4ab7-b82b-fd7b216bdfd2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16621821'] for floatingip, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:48.693709 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.db.l3_db [req-0571c0f6-f389-4618-80d7-2bc5009724b3 req-edf07e18-86ac-4ab7-b82b-fd7b216bdfd2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Floating IP db61d3b9-2e31-486b-8dd2-212bf03ec982 disassociated. External IP: 172.27.0.98, port: cd88a910-8740-4a3f-aafb-41a504f611ee.
May 31 16:27:48.694053 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [req-0571c0f6-f389-4618-80d7-2bc5009724b3 req-edf07e18-86ac-4ab7-b82b-fd7b216bdfd2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Calling delete_port for cd88a910-8740-4a3f-aafb-41a504f611ee owned by compute:nova {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:27:48.726755 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d3c2ac47-97f4-443d-abd1-a2d9898e083b tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:48.732220 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-8a579b0e-94b7-4d27-958b-f2ab6ea417c9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:48.748856 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3c2ac47-97f4-443d-abd1-a2d9898e083b tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8fbc8cfd-84c0-4533-a8cc-20e7833b04de,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:48.751862 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d3c2ac47-97f4-443d-abd1-a2d9898e083b tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:48.757854 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d3c2ac47-97f4-443d-abd1-a2d9898e083b tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:48.758978 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-d3c2ac47-97f4-443d-abd1-a2d9898e083b tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "DELETE /v2.0/security-groups/8fbc8cfd-84c0-4533-a8cc-20e7833b04de HTTP/1.1" status: 204  len: 168 time: 0.2073548
May 31 16:27:48.761700 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 37130) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:27:48.778280 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.api.v2.resource [None req-0c7a9e8b-b8c1-48af-8789-1c3cb420cbd8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] show failed (client error): The resource could not be found.
May 31 16:27:48.784579 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-0c7a9e8b-b8c1-48af-8789-1c3cb420cbd8 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "GET /v2.0/security-groups/8fbc8cfd-84c0-4533-a8cc-20e7833b04de HTTP/1.1" status: 404  len: 347 time: 0.0164070
May 31 16:27:48.784579 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 37134) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:27:48.824142 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-0571c0f6-f389-4618-80d7-2bc5009724b3 req-edf07e18-86ac-4ab7-b82b-fd7b216bdfd2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:48.830881 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:48.879851 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edf07e18-86ac-4ab7-b82b-fd7b216bdfd2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Pushing event deleted for resources: {'Port': ['ID=cd88a910-8740-4a3f-aafb-41a504f611ee,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:48.883704 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-edf07e18-86ac-4ab7-b82b-fd7b216bdfd2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:48.886882 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-0785dd86-de40-4355-9ea9-7db7cdd505da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426106fa0>, [{'id': '8471b167-8540-4806-9932-e05fcb75a12b', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:55Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '12203182731d4a61acb7fc5914aef425', 'gw_port': {'id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:83:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:19:56Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': 'db126eb4-e252-4765-86f1-09d3f20549df', 'name': '', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'mac_address': 'fa:16:3e:63:bd:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:04Z', 'updated_at': '2021-05-31T16:20:20Z', 'revision_number': 5, 'project_id': '12203182731d4a61acb7fc5914aef425', 'subnets': [{'id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:27:48.892018 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0785dd86-de40-4355-9ea9-7db7cdd505da None None] The sync data for ids ['8471b167-8540-4806-9932-e05fcb75a12b'] in dv-cinder-793814-1-iscsi is: [{'id': '8471b167-8540-4806-9932-e05fcb75a12b', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:55Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '12203182731d4a61acb7fc5914aef425', 'gw_port': {'id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:83:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:19:56Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': 'db126eb4-e252-4765-86f1-09d3f20549df', 'name': '', 'network_id': 'be7d7603-734f-43bb-92a8-ed07a835aeb5', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'mac_address': 'fa:16:3e:63:bd:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:20:04Z', 'updated_at': '2021-05-31T16:20:20Z', 'revision_number': 5, 'project_id': '12203182731d4a61acb7fc5914aef425', 'subnets': [{'id': 'eb5363fe-ee39-4adc-b299-6098caad681d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:27:49.037820 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-2b55d7c3-918a-4cd1-98dd-b9cff541d737 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Deleting port 8a39a909-ef85-4ee5-bd23-355dce119eaa {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:27:49.038402 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2b55d7c3-918a-4cd1-98dd-b9cff541d737 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:49.095308 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.l3_agent_scheduler [req-0571c0f6-f389-4618-80d7-2bc5009724b3 req-edf07e18-86ac-4ab7-b82b-fd7b216bdfd2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Router 2bcd5afd-bdf4-472d-8a91-95997718441c has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91764) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:27:49.195148 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc4045e3-b829-4efb-b532-54c5175afdb7 None None] New status for floating IP 06133069-c955-49dc-b4bc-d10700328eb1: DOWN {{(pid=91766) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 31 16:27:49.320370 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2b55d7c3-918a-4cd1-98dd-b9cff541d737 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:49.320870 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2b55d7c3-918a-4cd1-98dd-b9cff541d737 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:49.369375 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-0571c0f6-f389-4618-80d7-2bc5009724b3 req-edf07e18-86ac-4ab7-b82b-fd7b216bdfd2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91764) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:27:49.380821 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-836ee3d1-24c3-453e-84eb-fdd77f65f750 None None] Sync routers for ids ['2bcd5afd-bdf4-472d-8a91-95997718441c'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:27:49.403200 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-836ee3d1-24c3-453e-84eb-fdd77f65f750 None None] Routers {'2bcd5afd-bdf4-472d-8a91-95997718441c'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:27:49.403847 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-836ee3d1-24c3-453e-84eb-fdd77f65f750 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426645d60>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:27:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['2bcd5afd-bdf4-472d-8a91-95997718441c'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:27:49.542599 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-2b55d7c3-918a-4cd1-98dd-b9cff541d737 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Calling delete_port for 8a39a909-ef85-4ee5-bd23-355dce119eaa owned by network:floatingip {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:27:49.666463 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [req-0571c0f6-f389-4618-80d7-2bc5009724b3 req-edf07e18-86ac-4ab7-b82b-fd7b216bdfd2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] No DVR routers for this DVR port cd88a910-8740-4a3f-aafb-41a504f611ee on host hv-cinder-79381 {{(pid=91764) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:27:49.673150 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-0571c0f6-f389-4618-80d7-2bc5009724b3 req-edf07e18-86ac-4ab7-b82b-fd7b216bdfd2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:49.684260 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-b869778d-ac0d-4797-9ce2-c11c64001c6d req-ceb8251d-5d52-43b6-915f-f7cfd143056d tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Synchronizing usage tracker for tenant:a56002dfed61485aa4d9e237932e1abf on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:27:49.685969 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2b55d7c3-918a-4cd1-98dd-b9cff541d737 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:49.689231 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0571c0f6-f389-4618-80d7-2bc5009724b3 req-edf07e18-86ac-4ab7-b82b-fd7b216bdfd2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.63 "DELETE /v2.0/ports/cd88a910-8740-4a3f-aafb-41a504f611ee HTTP/1.1" status: 204  len: 173 time: 1.7277532
May 31 16:27:49.691049 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-48badd7a-5826-474c-9462-96f5cd157cb0 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:49.695982 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:49.698084 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-836ee3d1-24c3-453e-84eb-fdd77f65f750 None None] Set router 2bcd5afd-bdf4-472d-8a91-95997718441c gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:27:49.706719 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-b869778d-ac0d-4797-9ce2-c11c64001c6d req-ceb8251d-5d52-43b6-915f-f7cfd143056d tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Unset dirty status for tenant:a56002dfed61485aa4d9e237932e1abf on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:27:49.708850 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b869778d-ac0d-4797-9ce2-c11c64001c6d req-ceb8251d-5d52-43b6-915f-f7cfd143056d tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=e54682d5-964c-4bf7-b004-5718298ce580 HTTP/1.1" status: 200  len: 210 time: 0.2068622
May 31 16:27:49.749830 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b55d7c3-918a-4cd1-98dd-b9cff541d737 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Pushing event deleted for resources: {'Port': ['ID=8a39a909-ef85-4ee5-bd23-355dce119eaa,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:49.752710 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-2b55d7c3-918a-4cd1-98dd-b9cff541d737 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:49.855853 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2b55d7c3-918a-4cd1-98dd-b9cff541d737 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks [] for floatingip, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:49.869552 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-2b55d7c3-918a-4cd1-98dd-b9cff541d737 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for floatingip, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:49.870680 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-2b55d7c3-918a-4cd1-98dd-b9cff541d737 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] 10.222.0.43 "DELETE /v2.0/floatingips/06133069-c955-49dc-b4bc-d10700328eb1 HTTP/1.1" status: 204  len: 168 time: 1.0856998
May 31 16:27:49.892149 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e54682d5-964c-4bf7-b004-5718298ce580', 'name': 'network-vif-deleted', 'tag': 'cd88a910-8740-4a3f-aafb-41a504f611ee'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:27:49.894810 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5ff04530-36cc-471d-a514-60f09e39e33f" -d '{"events": [{"server_uuid": "e54682d5-964c-4bf7-b004-5718298ce580", "name": "network-vif-deleted", "tag": "cd88a910-8740-4a3f-aafb-41a504f611ee"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:27:49.951718 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:27:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aca04604-e60d-45c1-bf10-6ca7192e7281 x-openstack-request-id: req-aca04604-e60d-45c1-bf10-6ca7192e7281 {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:27:49.952090 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e54682d5-964c-4bf7-b004-5718298ce580", "name": "network-vif-deleted", "tag": "cd88a910-8740-4a3f-aafb-41a504f611ee", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:27:49.952384 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-aca04604-e60d-45c1-bf10-6ca7192e7281 {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:27:49.952825 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e54682d5-964c-4bf7-b004-5718298ce580', 'name': 'network-vif-deleted', 'tag': 'cd88a910-8740-4a3f-aafb-41a504f611ee', 'status': 'completed', 'code': 200}
May 31 16:27:50.042035 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-836ee3d1-24c3-453e-84eb-fdd77f65f750 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426645d60>, [{'id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:24:01Z', 'updated_at': '2021-05-31T16:24:06Z', 'revision_number': 4, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'gw_port': {'id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:d3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 468, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:02Z', 'updated_at': '2021-05-31T16:24:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '729c3966-0f99-4a7d-ab46-eadab5d24529', 'name': '', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'mac_address': 'fa:16:3e:23:3b:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_interface', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:04Z', 'updated_at': '2021-05-31T16:24:10Z', 'revision_number': 5, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'subnets': [{'id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:27:50.045947 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-836ee3d1-24c3-453e-84eb-fdd77f65f750 None None] Checking router: 2bcd5afd-bdf4-472d-8a91-95997718441c for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:27:50.054720 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-836ee3d1-24c3-453e-84eb-fdd77f65f750 None None] Routers {'2bcd5afd-bdf4-472d-8a91-95997718441c'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:27:50.055330 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-836ee3d1-24c3-453e-84eb-fdd77f65f750 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426645d60>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:27:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['2bcd5afd-bdf4-472d-8a91-95997718441c'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:27:50.246626 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-836ee3d1-24c3-453e-84eb-fdd77f65f750 None None] Set router 2bcd5afd-bdf4-472d-8a91-95997718441c gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:27:50.606410 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-836ee3d1-24c3-453e-84eb-fdd77f65f750 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426645d60>, [{'id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:24:01Z', 'updated_at': '2021-05-31T16:24:06Z', 'revision_number': 4, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'gw_port': {'id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:d3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 468, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:02Z', 'updated_at': '2021-05-31T16:24:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '729c3966-0f99-4a7d-ab46-eadab5d24529', 'name': '', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'mac_address': 'fa:16:3e:23:3b:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_interface', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:04Z', 'updated_at': '2021-05-31T16:24:10Z', 'revision_number': 5, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'subnets': [{'id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:27:50.610308 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-836ee3d1-24c3-453e-84eb-fdd77f65f750 None None] The sync data for ids ['2bcd5afd-bdf4-472d-8a91-95997718441c'] in dv-cinder-793814-1-iscsi is: [{'id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:24:01Z', 'updated_at': '2021-05-31T16:24:06Z', 'revision_number': 4, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'gw_port': {'id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:d3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 468, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:02Z', 'updated_at': '2021-05-31T16:24:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '729c3966-0f99-4a7d-ab46-eadab5d24529', 'name': '', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'mac_address': 'fa:16:3e:23:3b:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_interface', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:04Z', 'updated_at': '2021-05-31T16:24:10Z', 'revision_number': 5, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'subnets': [{'id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:27:50.815552 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91ac06b4-8ef0-4d1b-b5fd-ed928ff31c8d None None] New status for floating IP db61d3b9-2e31-486b-8dd2-212bf03ec982: DOWN {{(pid=91766) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 31 16:27:50.849385 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 37152) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:27:50.917381 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-361f21da-85d6-4be9-a01d-9aca289065b0 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:50.946312 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-361f21da-85d6-4be9-a01d-9aca289065b0 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:51.011692 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-361f21da-85d6-4be9-a01d-9aca289065b0 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:51.017216 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-a9188209-9449-437d-b134-622846bbc869 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:51.032651 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361f21da-85d6-4be9-a01d-9aca289065b0 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:51.035676 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-361f21da-85d6-4be9-a01d-9aca289065b0 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:51.044279 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-361f21da-85d6-4be9-a01d-9aca289065b0 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:51.045492 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-361f21da-85d6-4be9-a01d-9aca289065b0 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "DELETE /v2.0/security-groups/3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb HTTP/1.1" status: 204  len: 168 time: 0.1942058
May 31 16:27:51.048173 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 37156) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:27:51.065274 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.api.v2.resource [None req-7ac27580-6467-4090-97e6-cb0a5abfa569 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] show failed (client error): The resource could not be found.
May 31 16:27:51.066480 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-7ac27580-6467-4090-97e6-cb0a5abfa569 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups/3c8f6e77-ba5a-42b9-88fc-3ed5de60aafb HTTP/1.1" status: 404  len: 347 time: 0.0171831
May 31 16:27:51.069271 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 37160) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:27:51.296259 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-63a4454c-e324-42f2-bc41-a0cd908159cd tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Deleting port 82e8c89f-9311-4610-84a6-115ba250f936 {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:27:51.296644 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-63a4454c-e324-42f2-bc41-a0cd908159cd tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:51.324917 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 49427db6-0261-4969-89c1-47664fa8a818 no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:27:51.361242 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] No Port match for: 49427db6-0261-4969-89c1-47664fa8a818 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:27:51.361708 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 49427db6-0261-4969-89c1-47664fa8a818 not bound to the agent host hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:27:51.424328 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-63a4454c-e324-42f2-bc41-a0cd908159cd tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:51.424623 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-63a4454c-e324-42f2-bc41-a0cd908159cd tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:51.556550 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-63a4454c-e324-42f2-bc41-a0cd908159cd tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Calling delete_port for 82e8c89f-9311-4610-84a6-115ba250f936 owned by network:floatingip {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:27:51.681258 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-63a4454c-e324-42f2-bc41-a0cd908159cd tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:51.685032 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:51.729746 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63a4454c-e324-42f2-bc41-a0cd908159cd tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Pushing event deleted for resources: {'Port': ['ID=82e8c89f-9311-4610-84a6-115ba250f936,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:51.732166 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-63a4454c-e324-42f2-bc41-a0cd908159cd tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:51.825982 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-63a4454c-e324-42f2-bc41-a0cd908159cd tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for floatingip, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:51.845313 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-63a4454c-e324-42f2-bc41-a0cd908159cd tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for floatingip, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:51.846485 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-63a4454c-e324-42f2-bc41-a0cd908159cd tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "DELETE /v2.0/floatingips/db61d3b9-2e31-486b-8dd2-212bf03ec982 HTTP/1.1" status: 204  len: 168 time: 0.7761588
May 31 16:27:52.034633 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 37176) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:27:52.040207 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-7bce354d-a6ec-4b55-aacf-ded5d8101cb7 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Request body: {'security_group': {'name': 'tempest-securitygroup--356723497', 'description': 'tempest-description--2108881368'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:27:52.046132 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-7bce354d-a6ec-4b55-aacf-ded5d8101cb7 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:27:52.050263 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-7bce354d-a6ec-4b55-aacf-ded5d8101cb7 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Usage tracker for resource:security_group and tenant:a56002dfed61485aa4d9e237932e1abf is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:27:52.053826 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-7bce354d-a6ec-4b55-aacf-ded5d8101cb7 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:27:52.059482 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-7bce354d-a6ec-4b55-aacf-ded5d8101cb7 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:27:52.071654 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7bce354d-a6ec-4b55-aacf-ded5d8101cb7 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:52.091755 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-7bce354d-a6ec-4b55-aacf-ded5d8101cb7 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:27:52.095521 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-7bce354d-a6ec-4b55-aacf-ded5d8101cb7 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Usage tracker for resource:security_group_rule and tenant:a56002dfed61485aa4d9e237932e1abf is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:27:52.098307 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-7bce354d-a6ec-4b55-aacf-ded5d8101cb7 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:27:52.103893 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-7bce354d-a6ec-4b55-aacf-ded5d8101cb7 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:27:52.177217 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7bce354d-a6ec-4b55-aacf-ded5d8101cb7 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:52.181353 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7bce354d-a6ec-4b55-aacf-ded5d8101cb7 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:52.185193 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-aa080f58-6ec0-4a25-9f82-bf1543262104 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:52.231930 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bce354d-a6ec-4b55-aacf-ded5d8101cb7 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Pushing event updated for resources: {'SecurityGroup': ['ID=262b9ced-321b-4d26-bfbf-d4122b5b4b61,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:52.235571 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-7bce354d-a6ec-4b55-aacf-ded5d8101cb7 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:52.236756 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-7bce354d-a6ec-4b55-aacf-ded5d8101cb7 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:52.237978 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-7bce354d-a6ec-4b55-aacf-ded5d8101cb7 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 0.2022812
May 31 16:27:52.241749 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 37180) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:27:52.246981 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-38d8fcab-5b87-40a2-b3f5-49d8c2f23326 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Request body: {'security_group_rule': {'security_group_id': '262b9ced-321b-4d26-bfbf-d4122b5b4b61', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:27:52.253079 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-38d8fcab-5b87-40a2-b3f5-49d8c2f23326 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:27:52.257644 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-38d8fcab-5b87-40a2-b3f5-49d8c2f23326 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Usage tracker for resource:security_group_rule and tenant:a56002dfed61485aa4d9e237932e1abf is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:27:52.260458 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-38d8fcab-5b87-40a2-b3f5-49d8c2f23326 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:27:52.266162 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-38d8fcab-5b87-40a2-b3f5-49d8c2f23326 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:27:52.283118 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-38d8fcab-5b87-40a2-b3f5-49d8c2f23326 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:52.344318 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-38d8fcab-5b87-40a2-b3f5-49d8c2f23326 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:52.348018 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-38d8fcab-5b87-40a2-b3f5-49d8c2f23326 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:52.350949 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:52.373856 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38d8fcab-5b87-40a2-b3f5-49d8c2f23326 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=45e93071-87a5-45d7-b1a6-1cde0f68d865,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:52.376556 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-38d8fcab-5b87-40a2-b3f5-49d8c2f23326 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:52.383962 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-38d8fcab-5b87-40a2-b3f5-49d8c2f23326 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:52.385136 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-38d8fcab-5b87-40a2-b3f5-49d8c2f23326 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1423242
May 31 16:27:52.388465 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 37184) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:27:52.393486 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-81220764-a570-4104-b4fb-e9cf40c11d4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Request body: {'security_group_rule': {'security_group_id': '262b9ced-321b-4d26-bfbf-d4122b5b4b61', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:27:52.399500 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-81220764-a570-4104-b4fb-e9cf40c11d4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:27:52.403347 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-81220764-a570-4104-b4fb-e9cf40c11d4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Usage tracker for resource:security_group_rule and tenant:a56002dfed61485aa4d9e237932e1abf is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:27:52.406343 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-81220764-a570-4104-b4fb-e9cf40c11d4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:27:52.412584 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-81220764-a570-4104-b4fb-e9cf40c11d4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:27:52.428396 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-81220764-a570-4104-b4fb-e9cf40c11d4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:52.490396 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-81220764-a570-4104-b4fb-e9cf40c11d4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:52.494501 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-81220764-a570-4104-b4fb-e9cf40c11d4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435329'] for security_group_rule, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:52.501054 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:52.520125 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81220764-a570-4104-b4fb-e9cf40c11d4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7889c37b-edcc-44b1-91a5-c57acdaffeed,revision_number=0']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:52.523064 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-81220764-a570-4104-b4fb-e9cf40c11d4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:52.531611 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-81220764-a570-4104-b4fb-e9cf40c11d4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:52.532791 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-81220764-a570-4104-b4fb-e9cf40c11d4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1434176
May 31 16:27:52.535830 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 37190) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:27:52.541858 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Request body: {'floatingip': {'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:27:52.547734 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:27:52.552411 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Usage tracker for resource:floatingip and tenant:a56002dfed61485aa4d9e237932e1abf is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:27:52.555488 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:27:52.561175 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:27:52.571711 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for floatingip, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:52.686606 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 37198) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:27:52.714318 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:52.859566 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Allocated IP 172.27.0.228 (00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c/96709d85-d0fe-4cf8-b232-eaf6b143ebe6/da6def5b-4ec4-4d2d-b6a6-d3e6b5071783) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:27:53.105319 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:53.135569 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:53.140639 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-9d56b89e-ccf2-41b4-bef8-02e7d99fcb67 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:53.208154 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Network 00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:27:53.211341 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:27:53.215578 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:27:53.252569 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Pushing event updated for resources: {'Port': ['ID=da6def5b-4ec4-4d2d-b6a6-d3e6b5071783,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:53.261915 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:53.303966 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:53.329494 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device cd88a910-8740-4a3f-aafb-41a504f611ee no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:27:53.369029 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] No Port match for: cd88a910-8740-4a3f-aafb-41a504f611ee {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:27:53.369743 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device cd88a910-8740-4a3f-aafb-41a504f611ee not bound to the agent host hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:27:53.374921 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:53.375638 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b6fd3b33-7cef-4bba-82c4-e6b320ce5d09 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-16627919'] for router_interface, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:53.585763 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for port, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:53.590424 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14337082'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:53.594875 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:53.700787 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Pushing event updated for resources: {'Port': ['ID=da6def5b-4ec4-4d2d-b6a6-d3e6b5071783,revision_number=2']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:53.704593 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:53.713914 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16621821'] for floatingip, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:53.737373 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for floatingip, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:53.738615 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 1.2013278
May 31 16:27:53.798092 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-b6fd3b33-7cef-4bba-82c4-e6b320ce5d09 admin admin] Deleting port db126eb4-e252-4765-86f1-09d3f20549df {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:27:53.798678 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b6fd3b33-7cef-4bba-82c4-e6b320ce5d09 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:53.928550 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [None req-b6fd3b33-7cef-4bba-82c4-e6b320ce5d09 admin admin] For port db126eb4-e252-4765-86f1-09d3f20549df, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=db126eb4-e252-4765-86f1-09d3f20549df,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:27:53.928807 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b6fd3b33-7cef-4bba-82c4-e6b320ce5d09 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:54.075566 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-b6fd3b33-7cef-4bba-82c4-e6b320ce5d09 admin admin] Calling delete_port for db126eb4-e252-4765-86f1-09d3f20549df owned by network:router_interface {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:27:54.112675 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-ee50af09-54bb-4f81-8cdc-b2b0ac9a2a34 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-securitygroup--356723497&fields=id&tenant_id=a56002dfed61485aa4d9e237932e1abf HTTP/1.1" status: 200  len: 267 time: 0.1762199
May 31 16:27:54.549719 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-a2a30816-a5ec-4feb-9171-8c1793d0491d tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:54.551223 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-a2a30816-a5ec-4feb-9171-8c1793d0491d tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/networks?id=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 HTTP/1.1" status: 200  len: 810 time: 0.4311635
May 31 16:27:54.576654 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-8d244f96-45af-47ba-ae34-6521b6ab2142 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/quotas/a56002dfed61485aa4d9e237932e1abf HTTP/1.1" status: 200  len: 375 time: 0.0189636
May 31 16:27:54.714713 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b6fd3b33-7cef-4bba-82c4-e6b320ce5d09 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:54.718697 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:54.769587 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6fd3b33-7cef-4bba-82c4-e6b320ce5d09 admin admin] Pushing event deleted for resources: {'Port': ['ID=db126eb4-e252-4765-86f1-09d3f20549df,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:54.780343 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-b332a388-4d76-4589-ad1b-ec7379a34a48 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=a56002dfed61485aa4d9e237932e1abf&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1941350
May 31 16:27:54.807283 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-b6fd3b33-7cef-4bba-82c4-e6b320ce5d09 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:55.078496 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-a92d9ff2-0d59-4db9-8f77-047fefe33334 service neutron] 10.222.0.43 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2700636
May 31 16:27:55.262130 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b6fd3b33-7cef-4bba-82c4-e6b320ce5d09 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-16317375', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-16625247'] for router_interface, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:55.377749 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-2df1e68e-2098-49ae-8d1a-73904b27a420 service neutron] 10.222.0.43 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2409811
May 31 16:27:55.638547 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d021f882-ab86-460b-a20c-b59c59980dbf req-58216716-b55e-4b30-a581-8887d567ba20 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=6a420bce-c94a-4465-908e-a4e285a98869 HTTP/1.1" status: 200  len: 210 time: 0.0813415
May 31 16:27:55.892473 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b6fd3b33-7cef-4bba-82c4-e6b320ce5d09 admin admin] Router 8471b167-8540-4806-9932-e05fcb75a12b has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91764) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:27:56.094142 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b6fd3b33-7cef-4bba-82c4-e6b320ce5d09 admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91764) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:27:56.106754 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01328c5e-4c9b-4e79-a141-470fd9aedc59 None None] Sync routers for ids ['8471b167-8540-4806-9932-e05fcb75a12b'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:27:56.109141 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-b6fd3b33-7cef-4bba-82c4-e6b320ce5d09 admin admin] 10.222.0.43 "PUT /v2.0/routers/8471b167-8540-4806-9932-e05fcb75a12b/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 3.4214382
May 31 16:27:56.111133 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 37226) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:27:56.128721 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01328c5e-4c9b-4e79-a141-470fd9aedc59 None None] Routers {'8471b167-8540-4806-9932-e05fcb75a12b'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:27:56.130228 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-01328c5e-4c9b-4e79-a141-470fd9aedc59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f142635d790>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:27:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['8471b167-8540-4806-9932-e05fcb75a12b'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:27:56.301678 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3acc01da-607d-40cd-8f1c-7bfc07222ffc admin admin] Notify callbacks [] for router, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:56.325817 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-01328c5e-4c9b-4e79-a141-470fd9aedc59 None None] Set router 8471b167-8540-4806-9932-e05fcb75a12b gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:27:56.492550 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3acc01da-607d-40cd-8f1c-7bfc07222ffc admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:56.646582 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-01328c5e-4c9b-4e79-a141-470fd9aedc59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f142635d790>, [{'id': '8471b167-8540-4806-9932-e05fcb75a12b', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:55Z', 'updated_at': '2021-05-31T16:27:54Z', 'revision_number': 5, 'project_id': '12203182731d4a61acb7fc5914aef425', 'gw_port': {'id': 'ec87a42d-446b-48d8-8654-589a5b1f5357', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:b8:83:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8471b167-8540-4806-9932-e05fcb75a12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:19:56Z', 'updated_at': '2021-05-31T16:20:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:27:56.650809 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01328c5e-4c9b-4e79-a141-470fd9aedc59 None None] Checking router: 8471b167-8540-4806-9932-e05fcb75a12b for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:27:56.661256 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01328c5e-4c9b-4e79-a141-470fd9aedc59 None None] Routers {'8471b167-8540-4806-9932-e05fcb75a12b'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:27:56.662426 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-01328c5e-4c9b-4e79-a141-470fd9aedc59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f142635d790>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:27:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['8471b167-8540-4806-9932-e05fcb75a12b'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:27:56.697155 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-3acc01da-607d-40cd-8f1c-7bfc07222ffc admin admin] Deleting port ec87a42d-446b-48d8-8654-589a5b1f5357 {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:27:56.697728 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3acc01da-607d-40cd-8f1c-7bfc07222ffc admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:56.850332 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-01328c5e-4c9b-4e79-a141-470fd9aedc59 None None] Set router 8471b167-8540-4806-9932-e05fcb75a12b gateway port host: None {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:27:56.860773 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-15dc5c5e-c479-404b-80d9-e5878c178efe req-f33fd677-75d3-40b3-a3d2-a861f6fc97fb tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=6a420bce-c94a-4465-908e-a4e285a98869 HTTP/1.1" status: 200  len: 210 time: 0.0890436
May 31 16:27:56.870686 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-48b73621-6123-4987-8dd2-c7c1ba0671f4 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:56.872120 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-48b73621-6123-4987-8dd2-c7c1ba0671f4 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.63 "GET /v2.0/networks?id=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 HTTP/1.1" status: 200  len: 810 time: 0.3100152
May 31 16:27:56.950484 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-d7d703ad-2921-42f9-b091-8830bdb70766 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.63 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a56002dfed61485aa4d9e237932e1abf HTTP/1.1" status: 200  len: 379 time: 0.0620487
May 31 16:27:56.952160 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [None req-3acc01da-607d-40cd-8f1c-7bfc07222ffc admin admin] For port ec87a42d-446b-48d8-8654-589a5b1f5357, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=ec87a42d-446b-48d8-8654-589a5b1f5357,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:27:56.952550 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3acc01da-607d-40cd-8f1c-7bfc07222ffc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:56.961673 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-01328c5e-4c9b-4e79-a141-470fd9aedc59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f142635d790>, [{'id': '8471b167-8540-4806-9932-e05fcb75a12b', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:55Z', 'updated_at': '2021-05-31T16:27:56Z', 'revision_number': 6, 'project_id': '12203182731d4a61acb7fc5914aef425', 'gw_port_host': None}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:27:56.966390 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01328c5e-4c9b-4e79-a141-470fd9aedc59 None None] The sync data for ids ['8471b167-8540-4806-9932-e05fcb75a12b'] in dv-cinder-793814-1-iscsi is: [{'id': '8471b167-8540-4806-9932-e05fcb75a12b', 'name': 'tempest-AttachVolumeShelveTestJSON-884071623-router', 'tenant_id': '12203182731d4a61acb7fc5914aef425', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:19:55Z', 'updated_at': '2021-05-31T16:27:56Z', 'revision_number': 6, 'project_id': '12203182731d4a61acb7fc5914aef425', 'gw_port_host': None}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:27:56.969491 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-72b6f8a2-1e7b-48b6-9aef-85e40e213d06 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Request body: {'port': {'device_id': '6a420bce-c94a-4465-908e-a4e285a98869', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'admin_state_up': True, 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'security_groups': ['262b9ced-321b-4d26-bfbf-d4122b5b4b61']}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:27:57.156968 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-3acc01da-607d-40cd-8f1c-7bfc07222ffc admin admin] Calling delete_port for ec87a42d-446b-48d8-8654-589a5b1f5357 owned by network:router_gateway {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:27:57.248739 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-72b6f8a2-1e7b-48b6-9aef-85e40e213d06 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:27:57.254550 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-72b6f8a2-1e7b-48b6-9aef-85e40e213d06 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Usage tracker for resource:port and tenant:a56002dfed61485aa4d9e237932e1abf is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:27:57.258312 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-72b6f8a2-1e7b-48b6-9aef-85e40e213d06 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Quota usage for port was recalculated. Used quota:3. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:27:57.274062 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-72b6f8a2-1e7b-48b6-9aef-85e40e213d06 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:27:57.293065 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-72b6f8a2-1e7b-48b6-9aef-85e40e213d06 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Made reservation on behalf of a56002dfed61485aa4d9e237932e1abf for: {'port': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:27:57.297504 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-72b6f8a2-1e7b-48b6-9aef-85e40e213d06 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:57.650791 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3acc01da-607d-40cd-8f1c-7bfc07222ffc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:57.657470 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-3c657a59-1db6-43d2-8b14-9d151a6a238b tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:57.701479 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-72b6f8a2-1e7b-48b6-9aef-85e40e213d06 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Allocated IP 172.20.0.10 (cd1ac218-ff8f-46e5-91e3-f1ff613f07d5/6489943b-1236-4d7c-80a7-58ef5aedf09d/44642665-875e-4063-a715-b66d023bc8e7) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:27:57.713504 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3acc01da-607d-40cd-8f1c-7bfc07222ffc admin admin] Pushing event deleted for resources: {'Port': ['ID=ec87a42d-446b-48d8-8654-589a5b1f5357,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:57.741500 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-3acc01da-607d-40cd-8f1c-7bfc07222ffc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:57.861990 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3acc01da-607d-40cd-8f1c-7bfc07222ffc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-16621778'] for router_gateway, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:58.158281 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cbc8e3d8-736c-43af-b9e4-be2bc4f5780d req-6943b1f1-5467-4e56-a4ce-c63a62d3a24a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=6a420bce-c94a-4465-908e-a4e285a98869 HTTP/1.1" status: 200  len: 210 time: 0.1339502
May 31 16:27:58.159963 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3acc01da-607d-40cd-8f1c-7bfc07222ffc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-16623711', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-683'] for router, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:58.164662 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3acc01da-607d-40cd-8f1c-7bfc07222ffc admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:58.221280 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3acc01da-607d-40cd-8f1c-7bfc07222ffc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-16623971'] for router, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:58.221951 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3acc01da-607d-40cd-8f1c-7bfc07222ffc admin admin] Fanout notify agent at l3_agent the message router_deleted on router 8471b167-8540-4806-9932-e05fcb75a12b {{(pid=91764) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 31 16:27:58.238160 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-72b6f8a2-1e7b-48b6-9aef-85e40e213d06 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:58.264199 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3acc01da-607d-40cd-8f1c-7bfc07222ffc admin admin] Notify callbacks [] for router, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:58.265331 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-3acc01da-607d-40cd-8f1c-7bfc07222ffc admin admin] 10.222.0.43 "DELETE /v2.0/routers/8471b167-8540-4806-9932-e05fcb75a12b HTTP/1.1" status: 204  len: 168 time: 2.1532533
May 31 16:27:58.266514 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.provisioning_blocks [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-72b6f8a2-1e7b-48b6-9aef-85e40e213d06 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Transition to ACTIVE for port object 44642665-875e-4063-a715-b66d023bc8e7 will not be triggered until provisioned by entity DHCP. {{(pid=91764) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:27:58.268823 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 37238) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:27:58.300195 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-72b6f8a2-1e7b-48b6-9aef-85e40e213d06 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:58.307852 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-3acc01da-607d-40cd-8f1c-7bfc07222ffc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:58.340062 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_v2 [None req-5a74234f-afe9-4184-a093-302478fa417b admin admin] Deleting subnet eb5363fe-ee39-4adc-b299-6098caad681d {{(pid=91763) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 31 16:27:58.343368 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5a74234f-afe9-4184-a093-302478fa417b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:58.378005 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-72b6f8a2-1e7b-48b6-9aef-85e40e213d06 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Network cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:27:58.381768 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-72b6f8a2-1e7b-48b6-9aef-85e40e213d06 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:27:58.386228 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-72b6f8a2-1e7b-48b6-9aef-85e40e213d06 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:27:58.407710 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5a74234f-afe9-4184-a093-302478fa417b admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-15104879'] for subnet, precommit_delete_associations {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:58.418383 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72b6f8a2-1e7b-48b6-9aef-85e40e213d06 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Pushing event updated for resources: {'Port': ['ID=44642665-875e-4063-a715-b66d023bc8e7,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:58.425517 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-72b6f8a2-1e7b-48b6-9aef-85e40e213d06 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:58.444887 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device db126eb4-e252-4765-86f1-09d3f20549df no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:27:58.463683 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-72b6f8a2-1e7b-48b6-9aef-85e40e213d06 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:58.464366 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-72b6f8a2-1e7b-48b6-9aef-85e40e213d06 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:58.485658 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-72b6f8a2-1e7b-48b6-9aef-85e40e213d06 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.63 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.5243821
May 31 16:27:58.498175 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: db126eb4-e252-4765-86f1-09d3f20549df {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:27:58.498527 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device db126eb4-e252-4765-86f1-09d3f20549df not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:27:58.498949 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device ec87a42d-446b-48d8-8654-589a5b1f5357 no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:27:58.500496 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Request body: {'port': {'device_id': '6a420bce-c94a-4465-908e-a4e285a98869', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79381'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:27:58.506689 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5a74234f-afe9-4184-a093-302478fa417b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-975336'] for subnet, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:58.541750 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: ec87a42d-446b-48d8-8654-589a5b1f5357 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:27:58.542406 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device ec87a42d-446b-48d8-8654-589a5b1f5357 not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:27:58.632719 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:58.638131 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-3cd603b8-6da7-42e3-8442-f3bbe09fc243 None None] Provisioning for port 44642665-875e-4063-a715-b66d023bc8e7 completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:27:58.643439 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-3cd603b8-6da7-42e3-8442-f3bbe09fc243 None None] Provisioning complete for port 44642665-875e-4063-a715-b66d023bc8e7 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:27:58.643816 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-3cd603b8-6da7-42e3-8442-f3bbe09fc243 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:58.709903 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-3cd603b8-6da7-42e3-8442-f3bbe09fc243 None None] Port 44642665-875e-4063-a715-b66d023bc8e7 cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:27:58.805270 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5a74234f-afe9-4184-a093-302478fa417b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-978269', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14336704', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-13992643'] for subnet, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:58.809377 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-2a65a0ea-e2d0-4e69-b4f5-5d05fcad07fc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:58.845817 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a74234f-afe9-4184-a093-302478fa417b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=eb5363fe-ee39-4adc-b299-6098caad681d,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:58.847772 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5a74234f-afe9-4184-a093-302478fa417b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:58.853391 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-507efa18-de51-4212-b22d-99a667333522 None None] Network be7d7603-734f-43bb-92a8-ed07a835aeb5 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:27:58.853789 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-5a74234f-afe9-4184-a093-302478fa417b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:58.857594 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-5a74234f-afe9-4184-a093-302478fa417b admin admin] 10.222.0.43 "DELETE /v2.0/subnets/eb5363fe-ee39-4adc-b299-6098caad681d HTTP/1.1" status: 204  len: 168 time: 0.5845926
May 31 16:27:58.857803 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 37242) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:27:58.986109 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-525980'] for network, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:59.017718 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 44642665-875e-4063-a715-b66d023bc8e7 {{(pid=91764) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:27:59.027710 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:59.046328 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.provisioning_blocks [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Transition to ACTIVE for port object 44642665-875e-4063-a715-b66d023bc8e7 will not be triggered until provisioned by entity L2. {{(pid=91764) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:27:59.054388 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:59.059825 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-ae870d8e-4a6b-4fd3-957e-db25b3ba627d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:59.064503 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] Deleting port 84fd09f1-dd06-4f60-a27d-e40786f986b7 {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:27:59.064837 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:59.150353 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] DHCP port deletion for be7d7603-734f-43bb-92a8-ed07a835aeb5 request from dv-cinder-793814-1-iscsi {{(pid=91765) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 31 16:27:59.170898 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] For port 84fd09f1-dd06-4f60-a27d-e40786f986b7, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=84fd09f1-dd06-4f60-a27d-e40786f986b7,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:27:59.171588 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:59.174088 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:27:59.327623 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] Calling delete_port for 84fd09f1-dd06-4f60-a27d-e40786f986b7 owned by network:dhcp {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:27:59.360760 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] Deleting port 84fd09f1-dd06-4f60-a27d-e40786f986b7 {{(pid=91765) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:27:59.361716 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:59.450770 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Pushing event updated for resources: {'Port': ['ID=44642665-875e-4063-a715-b66d023bc8e7,revision_number=2']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:59.472027 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.412s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:59.484798 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] For port 84fd09f1-dd06-4f60-a27d-e40786f986b7, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=84fd09f1-dd06-4f60-a27d-e40786f986b7,segment=NetworkSegment(39cd3b8c-a501-4003-900e-4c3bab514801),segment_id=39cd3b8c-a501-4003-900e-4c3bab514801)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:27:59.485415 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:59.489639 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:59.494854 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-2f70d77f-9316-42f4-94a4-36f61c39776a tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:59.527109 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Attempting to bind port 44642665-875e-4063-a715-b66d023bc8e7 on host hv-cinder-79381 for vnic_type normal with profile  {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:27:59.527482 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Attempting to bind port 44642665-875e-4063-a715-b66d023bc8e7 by drivers openvswitch,hyperv on host hv-cinder-79381 at level 0 using segments [{'id': '1974822a-78ff-4607-935a-c9f5ba4a898d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5'}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:27:59.527782 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Attempting to bind port 44642665-875e-4063-a715-b66d023bc8e7 on network cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:27:59.536634 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Port 44642665-875e-4063-a715-b66d023bc8e7 on network cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79381 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 31 16:27:59.537145 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Attempting to bind port 44642665-875e-4063-a715-b66d023bc8e7 on network cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:27:59.539462 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] Pushing event deleted for resources: {'Port': ['ID=84fd09f1-dd06-4f60-a27d-e40786f986b7,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:59.542664 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:59.543804 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] No DVR routers for this DVR port 84fd09f1-dd06-4f60-a27d-e40786f986b7 on host dv-cinder-793814-1-iscsi {{(pid=91763) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:27:59.548871 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Checking agent: {'id': '4bed2638-4d91-4afb-bf81-aacca8584621', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79381', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'started_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 27, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:27:59.549216 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Checking segment: {'id': '1974822a-78ff-4607-935a-c9f5ba4a898d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:27:59.549641 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Bound using segment: {'id': '1974822a-78ff-4607-935a-c9f5ba4a898d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5'} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:27:59.550099 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Bound port: 44642665-875e-4063-a715-b66d023bc8e7, host: hv-cinder-79381, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1974822a-78ff-4607-935a-c9f5ba4a898d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 833, 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5'}}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:27:59.550454 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:59.570224 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cf72cfe-471d-4158-b1f9-217cd37d763c req-aa73ca44-fea7-4b97-b3b7-a2451661c4d0 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:59.570976 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-6cf72cfe-471d-4158-b1f9-217cd37d763c req-aa73ca44-fea7-4b97-b3b7-a2451661c4d0 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Synchronizing usage tracker for tenant:a56002dfed61485aa4d9e237932e1abf on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:27:59.632352 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] Calling delete_port for 84fd09f1-dd06-4f60-a27d-e40786f986b7 owned by network:dhcp {{(pid=91765) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:27:59.640325 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-6cf72cfe-471d-4158-b1f9-217cd37d763c req-aa73ca44-fea7-4b97-b3b7-a2451661c4d0 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Unset dirty status for tenant:a56002dfed61485aa4d9e237932e1abf on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:27:59.641547 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6cf72cfe-471d-4158-b1f9-217cd37d763c req-aa73ca44-fea7-4b97-b3b7-a2451661c4d0 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=6a420bce-c94a-4465-908e-a4e285a98869 HTTP/1.1" status: 200  len: 944 time: 0.2556627
May 31 16:27:59.674485 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-988775', 'neutron.services.segments.db._delete_segments_for_network-8732784586204'] for network, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:59.687232 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907'] for port, after_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:59.688397 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f14260cd760>,) {'filters': {'network_id': ['be7d7603-734f-43bb-92a8-ed07a835aeb5']}} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:27:59.692883 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:59.703885 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f14260cd760>, '39cd3b8c-a501-4003-900e-4c3bab514801') {'for_net_delete': True} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:27:59.704485 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f14260cd760>, '39cd3b8c-a501-4003-900e-4c3bab514801') {} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:27:59.706045 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] For port 44642665-875e-4063-a715-b66d023bc8e7, host hv-cinder-79381, cleared binding levels {{(pid=91764) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:27:59.717886 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6cf72cfe-471d-4158-b1f9-217cd37d763c req-27bd07ac-4a6a-4589-b3f0-4618efad8687 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=262b9ced-321b-4d26-bfbf-d4122b5b4b61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0598297
May 31 16:27:59.719230 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732784599197', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15104868'] for segment, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:59.721166 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] For port 44642665-875e-4063-a715-b66d023bc8e7, host hv-cinder-79381, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=44642665-875e-4063-a715-b66d023bc8e7,segment=NetworkSegment(1974822a-78ff-4607-935a-c9f5ba4a898d),segment_id=1974822a-78ff-4607-935a-c9f5ba4a898d)] {{(pid=91764) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:27:59.728254 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:59.742239 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-244ec0c8-85ee-4cfa-b2dd-f49992a68817 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:59.742475 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:59.748932 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] Releasing vlan 806 on physical network physnet1 to pool {{(pid=91763) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 31 16:27:59.749290 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14337126'] for segment, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:59.753183 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] Pushing event deleted for resources: {'Port': ['ID=84fd09f1-dd06-4f60-a27d-e40786f986b7,revision_number=None']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:59.756314 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] No DVR routers for this DVR port 84fd09f1-dd06-4f60-a27d-e40786f986b7 on host dv-cinder-793814-1-iscsi {{(pid=91765) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:27:59.765655 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:59.766080 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:59.766327 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:59.766655 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:59.766980 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:59.767380 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:59.767658 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:59.768303 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:59.768303 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:59.768577 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:59.768893 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:59.769174 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:27:59.774761 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:59.803000 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:59.803616 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:59.805088 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] 10.222.0.63 "PUT /v2.0/ports/44642665-875e-4063-a715-b66d023bc8e7 HTTP/1.1" status: 200  len: 1094 time: 1.3113616
May 31 16:27:59.805510 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6a420bce-c94a-4465-908e-a4e285a98869', 'tag': '44642665-875e-4063-a715-b66d023bc8e7'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:27:59.807855 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a4f622d4-c06e-4749-9be6-50ce1294c4e6" -d '{"events": [{"name": "network-changed", "server_uuid": "6a420bce-c94a-4465-908e-a4e285a98869", "tag": "44642665-875e-4063-a715-b66d023bc8e7"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]: Traceback (most recent call last):
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:     timer()
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:     cb(*args, **kw)
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:     return func(*args, **kwargs)
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:     self._notify()
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:     self.callback(batched_events)
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:     event.method(event)
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:     aggregate_uuid = self.p_client.list_aggregates(
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:     return f(self, *a, **k)
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self._get(url).json()
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self.request(url, 'GET', **kwargs)
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:     base_url = self.get_endpoint(auth, allow=allow,
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 31 16:27:59.858121 dv-cinder-793814-1-iscsi neutron-server[91763]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 31 16:27:59.871974 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16621775'] for network, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:59.877231 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:27:59.880842 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:27:59.889766 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:27:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a73b22db-7d89-4d6c-b67b-9c049c56b832 x-openstack-request-id: req-a73b22db-7d89-4d6c-b67b-9c049c56b832 {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:27:59.890156 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6a420bce-c94a-4465-908e-a4e285a98869", "tag": "44642665-875e-4063-a715-b66d023bc8e7", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:27:59.890374 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-a73b22db-7d89-4d6c-b67b-9c049c56b832 {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:27:59.890808 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6a420bce-c94a-4465-908e-a4e285a98869', 'tag': '44642665-875e-4063-a715-b66d023bc8e7', 'status': 'completed', 'code': 200}
May 31 16:27:59.891612 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Pushing event updated for resources: {'Port': ['ID=44642665-875e-4063-a715-b66d023bc8e7,revision_number=3']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:59.900191 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-0655c11c-9da5-40d6-8dec-96a30d447601 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:59.904562 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] Pushing event deleted for resources: {'Network': ['ID=be7d7603-734f-43bb-92a8-ed07a835aeb5,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:27:59.907453 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:27:59.928668 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-70e4aa86-6cbc-4570-8554-13cf8a08dc5a admin admin] 10.222.0.43 "DELETE /v2.0/networks/be7d7603-734f-43bb-92a8-ed07a835aeb5 HTTP/1.1" status: 204  len: 168 time: 1.0665519
May 31 16:27:59.947654 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-42599151-7790-44b2-ae37-32cb23bce445 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:27:59.949300 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-42599151-7790-44b2-ae37-32cb23bce445 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=a56002dfed61485aa4d9e237932e1abf&device_id=6a420bce-c94a-4465-908e-a4e285a98869 HTTP/1.1" status: 200  len: 1097 time: 0.0997548
May 31 16:28:00.033944 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-cb65baae-15ae-4128-88cf-8948a9d240c4 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=44642665-875e-4063-a715-b66d023bc8e7 HTTP/1.1" status: 200  len: 217 time: 0.0767908
May 31 16:28:00.071800 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 37252) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:28:00.106667 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-54c291cd-4a60-4c9a-9bd7-9c637d505a3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:00.108353 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-54c291cd-4a60-4c9a-9bd7-9c637d505a3a service neutron] 10.222.0.63 "GET /v2.0/subnets?id=6489943b-1236-4d7c-80a7-58ef5aedf09d HTTP/1.1" status: 200  len: 849 time: 0.0670917
May 31 16:28:00.126686 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-cb689e44-dceb-4068-aab5-34b1e11db997 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=12203182731d4a61acb7fc5914aef425&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0533700
May 31 16:28:00.130340 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 37256) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:28:00.201916 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-a2dae6a0-67d3-4550-93f8-867a527154cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:00.203429 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-a2dae6a0-67d3-4550-93f8-867a527154cf service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0871916
May 31 16:28:00.213315 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-cd9a61fd-80a0-4731-a38c-c285eefb94c9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:00.241635 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-cd9a61fd-80a0-4731-a38c-c285eefb94c9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:00.298871 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-cd9a61fd-80a0-4731-a38c-c285eefb94c9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:00.306790 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-86df04ef-3d9f-4edb-973f-49c529a08d9a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:28:00.331801 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd9a61fd-80a0-4731-a38c-c285eefb94c9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ef04aa34-ac88-44ba-87b5-bcf65d42774f,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:28:00.338761 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-cd9a61fd-80a0-4731-a38c-c285eefb94c9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:28:00.345025 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-cd9a61fd-80a0-4731-a38c-c285eefb94c9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:00.346247 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-cd9a61fd-80a0-4731-a38c-c285eefb94c9 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/ef04aa34-ac88-44ba-87b5-bcf65d42774f HTTP/1.1" status: 204  len: 168 time: 0.2145162
May 31 16:28:00.374667 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-4eda2a8b-c234-4910-9363-a77a20f8e989 service neutron] 10.222.0.63 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1634498
May 31 16:28:00.443311 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 84fd09f1-dd06-4f60-a27d-e40786f986b7 no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:28:00.480945 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: 84fd09f1-dd06-4f60-a27d-e40786f986b7 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:28:00.481297 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 84fd09f1-dd06-4f60-a27d-e40786f986b7 not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:28:00.538502 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-198fd429-0d17-4b97-8edb-2e3abd4d46db req-6b0c6f24-4456-43de-a6fd-43dc8bbd0268 service neutron] 10.222.0.63 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1566694
May 31 16:28:00.673634 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4f622d4-c06e-4749-9be6-50ce1294c4e6 req-ef27f4b5-a409-4ff8-8e20-2e105eaa4410 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:00.675344 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a4f622d4-c06e-4749-9be6-50ce1294c4e6 req-ef27f4b5-a409-4ff8-8e20-2e105eaa4410 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=a56002dfed61485aa4d9e237932e1abf&device_id=6a420bce-c94a-4465-908e-a4e285a98869 HTTP/1.1" status: 200  len: 1097 time: 0.0806401
May 31 16:28:00.830466 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4f622d4-c06e-4749-9be6-50ce1294c4e6 req-bd1c5597-708d-4c71-a95b-0d27f7c3ba33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:00.832029 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a4f622d4-c06e-4749-9be6-50ce1294c4e6 req-bd1c5597-708d-4c71-a95b-0d27f7c3ba33 service neutron] 10.222.0.63 "GET /v2.0/networks?id=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 HTTP/1.1" status: 200  len: 911 time: 0.1500757
May 31 16:28:00.944352 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a4f622d4-c06e-4749-9be6-50ce1294c4e6 req-6e1cf444-c488-435c-b144-1ca4464f2d97 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=44642665-875e-4063-a715-b66d023bc8e7 HTTP/1.1" status: 200  len: 217 time: 0.1057565
May 31 16:28:01.040695 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4f622d4-c06e-4749-9be6-50ce1294c4e6 req-dc7c824f-a6d7-430e-b5f9-e181d8afc908 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:01.042190 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a4f622d4-c06e-4749-9be6-50ce1294c4e6 req-dc7c824f-a6d7-430e-b5f9-e181d8afc908 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=6489943b-1236-4d7c-80a7-58ef5aedf09d HTTP/1.1" status: 200  len: 849 time: 0.0799916
May 31 16:28:01.053836 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c9fc913-150e-4920-a67c-4375d9459032 req-5e1bf07a-1569-4520-b5d4-66d23d2630ac tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:01.055324 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5c9fc913-150e-4920-a67c-4375d9459032 req-5e1bf07a-1569-4520-b5d4-66d23d2630ac tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=6a420bce-c94a-4465-908e-a4e285a98869 HTTP/1.1" status: 200  len: 944 time: 0.1623795
May 31 16:28:01.156891 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5c9fc913-150e-4920-a67c-4375d9459032 req-f6922c3c-26f2-43b8-b7b2-a95997903e33 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=262b9ced-321b-4d26-bfbf-d4122b5b4b61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0699689
May 31 16:28:01.178378 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4f622d4-c06e-4749-9be6-50ce1294c4e6 req-54531951-ed6c-44de-86c9-f1c1e0256d22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:01.178378 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a4f622d4-c06e-4749-9be6-50ce1294c4e6 req-54531951-ed6c-44de-86c9-f1c1e0256d22 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1172407
May 31 16:28:01.322217 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a4f622d4-c06e-4749-9be6-50ce1294c4e6 req-5405b4d4-0ab7-4f10-9535-b83d333cfb19 service neutron] 10.222.0.63 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1417902
May 31 16:28:01.604924 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a4f622d4-c06e-4749-9be6-50ce1294c4e6 req-81e525a4-e20f-4aa5-bd44-4f414fd1137f service neutron] 10.222.0.63 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2747996
May 31 16:28:02.359689 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02f69318-7e84-4b83-9baf-a622f90a2488 req-eec328d8-85f9-42bb-b442-04ba5fcbe7cb tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:02.361952 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-02f69318-7e84-4b83-9baf-a622f90a2488 req-eec328d8-85f9-42bb-b442-04ba5fcbe7cb tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=6a420bce-c94a-4465-908e-a4e285a98869 HTTP/1.1" status: 200  len: 944 time: 0.0944681
May 31 16:28:02.420778 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-02f69318-7e84-4b83-9baf-a622f90a2488 req-8f66cf45-4163-44eb-b863-5274c979c357 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=262b9ced-321b-4d26-bfbf-d4122b5b4b61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0516136
May 31 16:28:03.361649 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 44642665-875e-4063-a715-b66d023bc8e7 details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:28:03.496007 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 44642665-875e-4063-a715-b66d023bc8e7, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=44642665-875e-4063-a715-b66d023bc8e7,segment=NetworkSegment(1974822a-78ff-4607-935a-c9f5ba4a898d),segment_id=1974822a-78ff-4607-935a-c9f5ba4a898d)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:28:03.510601 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': '44642665-875e-4063-a715-b66d023bc8e7', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'port_id': '44642665-875e-4063-a715-b66d023bc8e7', 'mac_address': 'fa:16:3e:a7:2d:29', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 833, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:28:03.567101 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:03.584587 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 44642665-875e-4063-a715-b66d023bc8e7 {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:28:03.600927 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 44642665-875e-4063-a715-b66d023bc8e7, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=44642665-875e-4063-a715-b66d023bc8e7,segment=NetworkSegment(1974822a-78ff-4607-935a-c9f5ba4a898d),segment_id=1974822a-78ff-4607-935a-c9f5ba4a898d)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:28:03.605047 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:03.606897 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-395abea5-960c-43d6-86e8-c606dcc9dfa7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:28:03.623338 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4145d6d-70b9-428c-99fb-14ac66c2e861 req-f647f6b8-fc57-46f8-8f60-6b246c4d9aa5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:03.624720 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a4145d6d-70b9-428c-99fb-14ac66c2e861 req-f647f6b8-fc57-46f8-8f60-6b246c4d9aa5 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=6a420bce-c94a-4465-908e-a4e285a98869 HTTP/1.1" status: 200  len: 944 time: 0.0988998
May 31 16:28:03.682130 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a4145d6d-70b9-428c-99fb-14ac66c2e861 req-43b03c91-6072-4a75-9f88-7265cc241af7 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=262b9ced-321b-4d26-bfbf-d4122b5b4b61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0499659
May 31 16:28:03.687168 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=44642665-875e-4063-a715-b66d023bc8e7,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:28:03.690638 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:28:03.850189 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['44642665-875e-4063-a715-b66d023bc8e7'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:28:04.875774 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42ce2a5f-fe57-4b71-adab-99d675d835ec req-e91e0612-5db3-4d2b-9ab3-82add65d13ac tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:04.877826 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-42ce2a5f-fe57-4b71-adab-99d675d835ec req-e91e0612-5db3-4d2b-9ab3-82add65d13ac tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=6a420bce-c94a-4465-908e-a4e285a98869 HTTP/1.1" status: 200  len: 945 time: 0.0880764
May 31 16:28:04.931438 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-42ce2a5f-fe57-4b71-adab-99d675d835ec req-d7830181-689d-4d74-a6e6-cbdf835bac54 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=262b9ced-321b-4d26-bfbf-d4122b5b4b61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0469117
May 31 16:28:05.017854 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-fd35a72e-7453-4fa0-aac9-6bc217f1597b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:05.364187 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 44642665-875e-4063-a715-b66d023bc8e7 up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:28:05.439511 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning for port 44642665-875e-4063-a715-b66d023bc8e7 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:28:05.444205 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port 44642665-875e-4063-a715-b66d023bc8e7 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:28:05.444598 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:05.569730 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:05.597152 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6a420bce-c94a-4465-908e-a4e285a98869', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '44642665-875e-4063-a715-b66d023bc8e7'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:28:05.600007 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5ff5440b-0b95-4d23-a574-46cbe5445985" -d '{"events": [{"server_uuid": "6a420bce-c94a-4465-908e-a4e285a98869", "name": "network-vif-plugged", "status": "completed", "tag": "44642665-875e-4063-a715-b66d023bc8e7"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:28:05.608290 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 44642665-875e-4063-a715-b66d023bc8e7, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=44642665-875e-4063-a715-b66d023bc8e7,segment=NetworkSegment(1974822a-78ff-4607-935a-c9f5ba4a898d),segment_id=1974822a-78ff-4607-935a-c9f5ba4a898d)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:28:05.612901 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:05.615266 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:28:05.646945 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:28:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-96e4cbae-a465-4bf4-b99c-b89b220ae615 x-openstack-request-id: req-96e4cbae-a465-4bf4-b99c-b89b220ae615 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:28:05.647253 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6a420bce-c94a-4465-908e-a4e285a98869", "name": "network-vif-plugged", "status": "completed", "tag": "44642665-875e-4063-a715-b66d023bc8e7", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:28:05.647513 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-96e4cbae-a465-4bf4-b99c-b89b220ae615 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:28:05.647908 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6a420bce-c94a-4465-908e-a4e285a98869', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '44642665-875e-4063-a715-b66d023bc8e7', 'code': 200}
May 31 16:28:05.687793 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=44642665-875e-4063-a715-b66d023bc8e7,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:28:05.690721 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:28:05.879062 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d7cd8bd-9059-4552-9566-a32a0f150136 req-376ee523-e384-41c1-8e0f-ff0c1cccae55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:05.880982 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4d7cd8bd-9059-4552-9566-a32a0f150136 req-376ee523-e384-41c1-8e0f-ff0c1cccae55 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=6a420bce-c94a-4465-908e-a4e285a98869 HTTP/1.1" status: 200  len: 1099 time: 0.0746074
May 31 16:28:05.924081 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4d7cd8bd-9059-4552-9566-a32a0f150136 req-411eea29-86e7-474c-ae28-30f26dbb418f service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=262b9ced-321b-4d26-bfbf-d4122b5b4b61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0356598
May 31 16:28:06.121619 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d16fd29f-6e17-4538-8c1e-cdcc32130fa3 req-2e190766-cc25-471e-ab6c-ac94f9f3eae1 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:06.123096 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d16fd29f-6e17-4538-8c1e-cdcc32130fa3 req-2e190766-cc25-471e-ab6c-ac94f9f3eae1 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=6a420bce-c94a-4465-908e-a4e285a98869 HTTP/1.1" status: 200  len: 946 time: 0.0832820
May 31 16:28:06.172370 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d16fd29f-6e17-4538-8c1e-cdcc32130fa3 req-dcc36295-cb19-42ae-b2d0-90a61a40bb2a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=262b9ced-321b-4d26-bfbf-d4122b5b4b61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0432203
May 31 16:28:07.374460 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757deef0-4a7b-44cf-895f-b34b0a472683 req-53eed24a-5764-4e2a-b854-384013801b3e tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:07.376176 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-757deef0-4a7b-44cf-895f-b34b0a472683 req-53eed24a-5764-4e2a-b854-384013801b3e tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=6a420bce-c94a-4465-908e-a4e285a98869 HTTP/1.1" status: 200  len: 946 time: 0.0818665
May 31 16:28:07.421692 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-757deef0-4a7b-44cf-895f-b34b0a472683 req-ec04c71f-450b-4a3b-a418-dd7533cdc9f9 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=262b9ced-321b-4d26-bfbf-d4122b5b4b61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0391085
May 31 16:28:07.612251 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f6a0382-c53d-45cb-b4bf-204608905807 req-516bea57-88f8-43d6-b38a-2a05de4b2540 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:07.613737 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4f6a0382-c53d-45cb-b4bf-204608905807 req-516bea57-88f8-43d6-b38a-2a05de4b2540 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=6a420bce-c94a-4465-908e-a4e285a98869 HTTP/1.1" status: 200  len: 946 time: 0.0851851
May 31 16:28:07.622994 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 37366) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:28:07.628423 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-babf2b46-947b-4e04-a42b-ca02f36481a2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Request body: {'floatingip': {'port_id': '44642665-875e-4063-a715-b66d023bc8e7'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:28:07.706657 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-babf2b46-947b-4e04-a42b-ca02f36481a2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for floatingip, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:07.905124 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:08.222350 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-4ae8aea3-3a4b-41e2-af6f-88a2fb20771a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:08.433030 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-babf2b46-947b-4e04-a42b-ca02f36481a2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:08.436794 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-babf2b46-947b-4e04-a42b-ca02f36481a2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16621821'] for floatingip, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:08.605251 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.db.l3_db [None req-babf2b46-947b-4e04-a42b-ca02f36481a2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Floating IP 74ce6971-6765-48e0-b2f2-855bd8869e45 associated. External IP: 172.27.0.228, port: 44642665-875e-4063-a715-b66d023bc8e7.
May 31 16:28:08.978079 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-babf2b46-947b-4e04-a42b-ca02f36481a2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Router 2bcd5afd-bdf4-472d-8a91-95997718441c has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91764) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:28:09.164810 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-babf2b46-947b-4e04-a42b-ca02f36481a2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91764) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:28:09.169833 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-babf2b46-947b-4e04-a42b-ca02f36481a2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for floatingip, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:09.175615 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d741078f-1a70-4f65-a51e-3d7948e576a0 None None] Sync routers for ids ['2bcd5afd-bdf4-472d-8a91-95997718441c'] in dv-cinder-793814-1-iscsi {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:28:09.180718 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:09.188109 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d741078f-1a70-4f65-a51e-3d7948e576a0 None None] Routers {'2bcd5afd-bdf4-472d-8a91-95997718441c'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:28:09.189006 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-d741078f-1a70-4f65-a51e-3d7948e576a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426c11df0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:28:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['2bcd5afd-bdf4-472d-8a91-95997718441c'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:28:09.233144 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-babf2b46-947b-4e04-a42b-ca02f36481a2 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "PUT /v2.0/floatingips/74ce6971-6765-48e0-b2f2-855bd8869e45 HTTP/1.1" status: 200  len: 992 time: 1.6061456
May 31 16:28:09.233144 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6a420bce-c94a-4465-908e-a4e285a98869', 'tag': '44642665-875e-4063-a715-b66d023bc8e7'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:28:09.233440 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3ed3f57e-c128-4e7e-a477-7dd3940aec1b" -d '{"events": [{"name": "network-changed", "server_uuid": "6a420bce-c94a-4465-908e-a4e285a98869", "tag": "44642665-875e-4063-a715-b66d023bc8e7"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:28:09.289114 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:28:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-884d5a75-7c4e-4c08-bd0e-38bb338ddce6 x-openstack-request-id: req-884d5a75-7c4e-4c08-bd0e-38bb338ddce6 {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:28:09.289445 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6a420bce-c94a-4465-908e-a4e285a98869", "tag": "44642665-875e-4063-a715-b66d023bc8e7", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:28:09.289760 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-884d5a75-7c4e-4c08-bd0e-38bb338ddce6 {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:28:09.290196 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6a420bce-c94a-4465-908e-a4e285a98869', 'tag': '44642665-875e-4063-a715-b66d023bc8e7', 'status': 'completed', 'code': 200}
May 31 16:28:09.413193 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ed3f57e-c128-4e7e-a477-7dd3940aec1b req-aa25b55e-d3ab-4350-945d-fd39284a0ff9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:09.415099 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3ed3f57e-c128-4e7e-a477-7dd3940aec1b req-aa25b55e-d3ab-4350-945d-fd39284a0ff9 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=a56002dfed61485aa4d9e237932e1abf&device_id=6a420bce-c94a-4465-908e-a4e285a98869 HTTP/1.1" status: 200  len: 1099 time: 0.0886889
May 31 16:28:09.439431 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-d741078f-1a70-4f65-a51e-3d7948e576a0 None None] Set router 2bcd5afd-bdf4-472d-8a91-95997718441c gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:28:09.576866 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ed3f57e-c128-4e7e-a477-7dd3940aec1b req-61f27803-540e-4f92-8fa6-6f601c766118 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:09.578363 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3ed3f57e-c128-4e7e-a477-7dd3940aec1b req-61f27803-540e-4f92-8fa6-6f601c766118 service neutron] 10.222.0.63 "GET /v2.0/networks?id=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 HTTP/1.1" status: 200  len: 911 time: 0.1549954
May 31 16:28:09.688938 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3ed3f57e-c128-4e7e-a477-7dd3940aec1b req-f8886613-265f-4532-b654-58c12ccf846d service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=44642665-875e-4063-a715-b66d023bc8e7 HTTP/1.1" status: 200  len: 1000 time: 0.1027195
May 31 16:28:09.755690 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ed3f57e-c128-4e7e-a477-7dd3940aec1b req-3369fd6a-9b6f-40a3-b5af-9a805dec7305 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:09.757058 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3ed3f57e-c128-4e7e-a477-7dd3940aec1b req-3369fd6a-9b6f-40a3-b5af-9a805dec7305 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=6489943b-1236-4d7c-80a7-58ef5aedf09d HTTP/1.1" status: 200  len: 849 time: 0.0614979
May 31 16:28:09.846655 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ed3f57e-c128-4e7e-a477-7dd3940aec1b req-7ce81dad-4a51-42ec-a1f3-5d52d3f2edef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:09.848063 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3ed3f57e-c128-4e7e-a477-7dd3940aec1b req-7ce81dad-4a51-42ec-a1f3-5d52d3f2edef service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0829353
May 31 16:28:09.871817 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-d741078f-1a70-4f65-a51e-3d7948e576a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426c11df0>, [{'id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:24:01Z', 'updated_at': '2021-05-31T16:24:06Z', 'revision_number': 4, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'gw_port': {'id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:d3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 468, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:02Z', 'updated_at': '2021-05-31T16:24:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': '74ce6971-6765-48e0-b2f2-855bd8869e45', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'floating_ip_address': '172.27.0.228', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'port_id': '44642665-875e-4063-a715-b66d023bc8e7', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 582, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'mac_address': 'fa:16:3e:a7:2d:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a420bce-c94a-4465-908e-a4e285a98869', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:27:53Z', 'updated_at': '2021-05-31T16:28:08Z', 'revision_number': 1, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '729c3966-0f99-4a7d-ab46-eadab5d24529', 'name': '', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'mac_address': 'fa:16:3e:23:3b:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_interface', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:04Z', 'updated_at': '2021-05-31T16:24:10Z', 'revision_number': 5, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'subnets': [{'id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:28:09.875740 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d741078f-1a70-4f65-a51e-3d7948e576a0 None None] Checking router: 2bcd5afd-bdf4-472d-8a91-95997718441c for host: dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:28:09.884969 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d741078f-1a70-4f65-a51e-3d7948e576a0 None None] Routers {'2bcd5afd-bdf4-472d-8a91-95997718441c'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:28:09.885587 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-d741078f-1a70-4f65-a51e-3d7948e576a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426c11df0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:28:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['2bcd5afd-bdf4-472d-8a91-95997718441c'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:28:09.983081 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3ed3f57e-c128-4e7e-a477-7dd3940aec1b req-818537f3-feec-485e-b138-1a57b60ec0a1 service neutron] 10.222.0.63 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1277797
May 31 16:28:10.067979 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-d741078f-1a70-4f65-a51e-3d7948e576a0 None None] Set router 2bcd5afd-bdf4-472d-8a91-95997718441c gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:28:10.239172 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-3ed3f57e-c128-4e7e-a477-7dd3940aec1b req-7df366e9-f470-4ca2-b91b-d625763cb88d service neutron] 10.222.0.63 "GET /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2483840
May 31 16:28:10.418945 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-d741078f-1a70-4f65-a51e-3d7948e576a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426c11df0>, [{'id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:24:01Z', 'updated_at': '2021-05-31T16:24:06Z', 'revision_number': 4, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'gw_port': {'id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:d3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 468, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:02Z', 'updated_at': '2021-05-31T16:24:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': '74ce6971-6765-48e0-b2f2-855bd8869e45', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'floating_ip_address': '172.27.0.228', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'port_id': '44642665-875e-4063-a715-b66d023bc8e7', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 582, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'mac_address': 'fa:16:3e:a7:2d:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a420bce-c94a-4465-908e-a4e285a98869', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:27:53Z', 'updated_at': '2021-05-31T16:28:08Z', 'revision_number': 1, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '729c3966-0f99-4a7d-ab46-eadab5d24529', 'name': '', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'mac_address': 'fa:16:3e:23:3b:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_interface', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:04Z', 'updated_at': '2021-05-31T16:24:10Z', 'revision_number': 5, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'subnets': [{'id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:28:10.423235 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d741078f-1a70-4f65-a51e-3d7948e576a0 None None] The sync data for ids ['2bcd5afd-bdf4-472d-8a91-95997718441c'] in dv-cinder-793814-1-iscsi is: [{'id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:24:01Z', 'updated_at': '2021-05-31T16:24:06Z', 'revision_number': 4, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'gw_port': {'id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:d3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 468, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:02Z', 'updated_at': '2021-05-31T16:24:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_floatingips': [{'id': '74ce6971-6765-48e0-b2f2-855bd8869e45', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'floating_ip_address': '172.27.0.228', 'floating_network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'router_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'port_id': '44642665-875e-4063-a715-b66d023bc8e7', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 582, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'mac_address': 'fa:16:3e:a7:2d:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a420bce-c94a-4465-908e-a4e285a98869', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-31T16:27:53Z', 'updated_at': '2021-05-31T16:28:08Z', 'revision_number': 1, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '729c3966-0f99-4a7d-ab46-eadab5d24529', 'name': '', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'mac_address': 'fa:16:3e:23:3b:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_interface', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:04Z', 'updated_at': '2021-05-31T16:24:10Z', 'revision_number': 5, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'subnets': [{'id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:28:10.604201 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77ed1065-d175-4778-b98d-b98979d3515e None None] New status for floating IP 74ce6971-6765-48e0-b2f2-855bd8869e45: ACTIVE {{(pid=91765) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 31 16:28:10.890541 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:15.942131 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2b8b2685-935e-4370-b298-fc217ab9c193 req-646925b6-841a-4e44-9f28-540486a59dee service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0703330
May 31 16:28:16.086910 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b8b2685-935e-4370-b298-fc217ab9c193 req-4dca3c80-041c-41c3-a5ed-cfd6fe00ec27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:16.088738 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2b8b2685-935e-4370-b298-fc217ab9c193 req-4dca3c80-041c-41c3-a5ed-cfd6fe00ec27 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=092115f69b8e401b8c334f7b3e797aad&device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 1098 time: 0.0721133
May 31 16:28:16.244634 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b8b2685-935e-4370-b298-fc217ab9c193 req-35929cfd-4610-4c47-9044-10f975721552 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:16.246021 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2b8b2685-935e-4370-b298-fc217ab9c193 req-35929cfd-4610-4c47-9044-10f975721552 service neutron] 10.222.0.63 "GET /v2.0/networks?id=5b237728-dc31-4203-bbac-66ce3db1593a HTTP/1.1" status: 200  len: 913 time: 0.1356196
May 31 16:28:16.368577 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2b8b2685-935e-4370-b298-fc217ab9c193 req-e594b99e-04d0-4de5-a28b-b45991182858 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=31d7a0be-14fe-4eee-8a37-db20d72be4ab HTTP/1.1" status: 200  len: 1000 time: 0.1161337
May 31 16:28:16.438074 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b8b2685-935e-4370-b298-fc217ab9c193 req-e5f4d225-0695-48ff-9579-da918b6187f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:16.439447 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2b8b2685-935e-4370-b298-fc217ab9c193 req-e5f4d225-0695-48ff-9579-da918b6187f3 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=995d9a2e-7e88-458e-9385-d135c0e07276 HTTP/1.1" status: 200  len: 851 time: 0.0608010
May 31 16:28:16.523941 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b8b2685-935e-4370-b298-fc217ab9c193 req-b0fd3204-07a3-4d6a-9b96-0dc47e10f22e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:28:16.525343 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2b8b2685-935e-4370-b298-fc217ab9c193 req-b0fd3204-07a3-4d6a-9b96-0dc47e10f22e service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=5b237728-dc31-4203-bbac-66ce3db1593a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0797980
May 31 16:28:16.659832 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2b8b2685-935e-4370-b298-fc217ab9c193 req-c612f368-e36a-4096-9ad0-85697568d4a4 service neutron] 10.222.0.63 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1272120
May 31 16:28:16.799217 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-2b8b2685-935e-4370-b298-fc217ab9c193 req-1d164e2b-c3a3-40b8-a7f4-6641fe4b9e8e service neutron] 10.222.0.63 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1290758
May 31 16:28:18.922777 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 37510) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:28:19.044276 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:19.058534 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:28:19.062488 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] Usage tracker for resource:security_group_rule and tenant:18bf77c50c96484cbe3401f008c40135 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:28:19.065442 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:28:19.072079 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:28:19.156416 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:19.160211 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:19.167209 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:28:19.209538 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e0d26327-ffbb-4e7b-a710-57be3147f76f,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:28:19.213238 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=18bf77c50c96484cbe3401f008c40135&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2893910
May 31 16:28:19.215957 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 37516) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:28:19.219183 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:19.219565 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:19.219933 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:19.220296 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:19.220654 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:19.221013 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:19.221369 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:19.221748 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:19.222106 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:19.222460 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:19.222811 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:19.223734 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:19.227710 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-fca1ab0d-f9a2-49bf-9b7a-ad3f5b4a37c0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:28:19.275796 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-cd7dc232-48c1-462f-85ed-6fc5fff20d4a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:19.301119 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-cd7dc232-48c1-462f-85ed-6fc5fff20d4a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:19.364990 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-cd7dc232-48c1-462f-85ed-6fc5fff20d4a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:19.368917 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-2647ff7f-00b2-4e81-86a8-a270fe33e447 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:28:19.380735 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd7dc232-48c1-462f-85ed-6fc5fff20d4a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e0d26327-ffbb-4e7b-a710-57be3147f76f,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:28:19.384704 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-cd7dc232-48c1-462f-85ed-6fc5fff20d4a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:28:19.388052 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-cd7dc232-48c1-462f-85ed-6fc5fff20d4a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:19.389873 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-cd7dc232-48c1-462f-85ed-6fc5fff20d4a admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/e0d26327-ffbb-4e7b-a710-57be3147f76f HTTP/1.1" status: 204  len: 168 time: 0.1728714
May 31 16:28:19.672916 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 37526) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:28:19.690762 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-676e1cdf-752c-483f-8803-46e2dc26bcb4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:19.692387 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:19.705082 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-676e1cdf-752c-483f-8803-46e2dc26bcb4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:28:19.708981 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-676e1cdf-752c-483f-8803-46e2dc26bcb4 admin admin] Usage tracker for resource:security_group_rule and tenant:f41a63d2966d4b2583173d29b0606393 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:28:19.711840 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-676e1cdf-752c-483f-8803-46e2dc26bcb4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:28:19.717498 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-676e1cdf-752c-483f-8803-46e2dc26bcb4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:28:19.802542 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-676e1cdf-752c-483f-8803-46e2dc26bcb4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:19.806179 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-676e1cdf-752c-483f-8803-46e2dc26bcb4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:19.813010 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-04e480de-8cce-4eeb-bc0c-a9ac81fda1c8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:28:19.852109 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-676e1cdf-752c-483f-8803-46e2dc26bcb4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7a3a24c1-5101-492c-8b96-cf550e63bf57,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:28:19.856208 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-676e1cdf-752c-483f-8803-46e2dc26bcb4 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=f41a63d2966d4b2583173d29b0606393&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1822679
May 31 16:28:19.857079 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-676e1cdf-752c-483f-8803-46e2dc26bcb4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:28:19.859046 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 37530) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:28:19.920208 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-fb358ebf-a398-4c52-9180-abc2138a31ac admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:19.950507 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-fb358ebf-a398-4c52-9180-abc2138a31ac admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:20.002423 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-fb358ebf-a398-4c52-9180-abc2138a31ac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:20.008710 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-5f4034a9-0786-45f7-94d9-d616d88105f0 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:28:20.022111 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb358ebf-a398-4c52-9180-abc2138a31ac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a3a24c1-5101-492c-8b96-cf550e63bf57,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:28:20.024701 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-fb358ebf-a398-4c52-9180-abc2138a31ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:28:20.025926 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-fb358ebf-a398-4c52-9180-abc2138a31ac admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:20.027199 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-fb358ebf-a398-4c52-9180-abc2138a31ac admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/7a3a24c1-5101-492c-8b96-cf550e63bf57 HTTP/1.1" status: 204  len: 168 time: 0.1672833
May 31 16:28:33.019744 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 37694) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:28:33.137151 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-422bc1f4-d376-4911-ae08-0ec3a7846a89 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:33.151118 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-422bc1f4-d376-4911-ae08-0ec3a7846a89 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:28:33.155226 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-422bc1f4-d376-4911-ae08-0ec3a7846a89 admin admin] Usage tracker for resource:security_group_rule and tenant:f9c1416195294626968bebb4b8d25916 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:28:33.158857 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-422bc1f4-d376-4911-ae08-0ec3a7846a89 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:28:33.165015 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-422bc1f4-d376-4911-ae08-0ec3a7846a89 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:28:33.250200 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-422bc1f4-d376-4911-ae08-0ec3a7846a89 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:33.254379 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-422bc1f4-d376-4911-ae08-0ec3a7846a89 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:33.261346 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c90de5cc-c820-4243-a651-66f756c4958f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:28:33.300794 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-422bc1f4-d376-4911-ae08-0ec3a7846a89 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6fc331e8-8a7e-49ef-8eab-b1119ea09e6d,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:28:33.304843 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-422bc1f4-d376-4911-ae08-0ec3a7846a89 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:28:33.307518 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-422bc1f4-d376-4911-ae08-0ec3a7846a89 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=f9c1416195294626968bebb4b8d25916&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2867928
May 31 16:28:33.310308 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 37700) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:28:33.371557 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-55fc11ff-b010-41d6-a044-98b773cef6e2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:33.396781 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-55fc11ff-b010-41d6-a044-98b773cef6e2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:33.448653 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-55fc11ff-b010-41d6-a044-98b773cef6e2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:33.453579 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-faf97f01-da86-490e-81d9-d37aeb80c56b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:28:33.466129 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55fc11ff-b010-41d6-a044-98b773cef6e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6fc331e8-8a7e-49ef-8eab-b1119ea09e6d,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:28:33.468680 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-55fc11ff-b010-41d6-a044-98b773cef6e2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:28:33.469898 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-55fc11ff-b010-41d6-a044-98b773cef6e2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:33.471412 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-55fc11ff-b010-41d6-a044-98b773cef6e2 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/6fc331e8-8a7e-49ef-8eab-b1119ea09e6d HTTP/1.1" status: 204  len: 168 time: 0.1599238
May 31 16:28:33.752983 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 37710) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:28:33.771611 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9cd92404-19ad-4350-9709-bb3d83acddd5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:33.785884 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-9cd92404-19ad-4350-9709-bb3d83acddd5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:28:33.790502 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-9cd92404-19ad-4350-9709-bb3d83acddd5 admin admin] Usage tracker for resource:security_group_rule and tenant:efefb6d57f8c48bf8a656aed9494ea9c is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:28:33.793326 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-9cd92404-19ad-4350-9709-bb3d83acddd5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:28:33.799020 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-9cd92404-19ad-4350-9709-bb3d83acddd5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:28:33.881478 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9cd92404-19ad-4350-9709-bb3d83acddd5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:33.885092 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9cd92404-19ad-4350-9709-bb3d83acddd5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:33.893280 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-8a46918a-dfce-436e-8db7-02a490f0c24e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:28:33.933858 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-9cd92404-19ad-4350-9709-bb3d83acddd5 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=efefb6d57f8c48bf8a656aed9494ea9c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1796687
May 31 16:28:33.934837 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cd92404-19ad-4350-9709-bb3d83acddd5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c64179d1-47cf-40de-81f4-bae26a558d8d,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:28:33.936441 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 37714) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:28:33.938126 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-9cd92404-19ad-4350-9709-bb3d83acddd5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:28:34.000591 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-448387cf-64d8-4f8a-a62a-109265ba6d8a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:34.027920 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-448387cf-64d8-4f8a-a62a-109265ba6d8a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:34.077992 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-448387cf-64d8-4f8a-a62a-109265ba6d8a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:34.081635 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-258a2702-f15f-43a4-b5aa-9e43a024425c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:28:34.095896 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-448387cf-64d8-4f8a-a62a-109265ba6d8a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c64179d1-47cf-40de-81f4-bae26a558d8d,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:28:34.100035 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-448387cf-64d8-4f8a-a62a-109265ba6d8a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:28:34.103162 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-448387cf-64d8-4f8a-a62a-109265ba6d8a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:34.107033 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-448387cf-64d8-4f8a-a62a-109265ba6d8a admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/c64179d1-47cf-40de-81f4-bae26a558d8d HTTP/1.1" status: 204  len: 168 time: 0.1666949
May 31 16:28:35.210064 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-1850b9d6-e30e-4893-9634-6a1edd3c830d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:35.369319 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 37748) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:28:35.484527 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-45cb57de-cb2d-4c8c-9c12-38726f234762 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:35.498438 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-45cb57de-cb2d-4c8c-9c12-38726f234762 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:28:35.502531 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-45cb57de-cb2d-4c8c-9c12-38726f234762 admin admin] Usage tracker for resource:security_group_rule and tenant:7bd4b350ba8543dda52b4f4dda41a6fe is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:28:35.505861 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-45cb57de-cb2d-4c8c-9c12-38726f234762 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:28:35.511538 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-45cb57de-cb2d-4c8c-9c12-38726f234762 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:28:35.598310 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-45cb57de-cb2d-4c8c-9c12-38726f234762 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:35.602097 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-45cb57de-cb2d-4c8c-9c12-38726f234762 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:35.610383 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-8ad976b1-f8e2-4d7d-9286-014058da95d2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:28:35.650554 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-45cb57de-cb2d-4c8c-9c12-38726f234762 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=7bd4b350ba8543dda52b4f4dda41a6fe&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2801592
May 31 16:28:35.651468 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45cb57de-cb2d-4c8c-9c12-38726f234762 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=35b2472c-2f59-40a1-8d1f-c262754ddd57,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:28:35.653255 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 37754) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:28:35.654446 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-45cb57de-cb2d-4c8c-9c12-38726f234762 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:28:35.713613 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-37bb9ad9-62d1-405d-9e18-b9fb1d889dea admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:35.739340 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-37bb9ad9-62d1-405d-9e18-b9fb1d889dea admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:35.791395 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-37bb9ad9-62d1-405d-9e18-b9fb1d889dea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:35.795291 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-df13f337-404f-4d88-af92-8aef9330c8af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:28:35.806072 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37bb9ad9-62d1-405d-9e18-b9fb1d889dea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=35b2472c-2f59-40a1-8d1f-c262754ddd57,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:28:35.808489 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-37bb9ad9-62d1-405d-9e18-b9fb1d889dea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:28:35.814081 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-37bb9ad9-62d1-405d-9e18-b9fb1d889dea admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:35.815191 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-37bb9ad9-62d1-405d-9e18-b9fb1d889dea admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/35b2472c-2f59-40a1-8d1f-c262754ddd57 HTTP/1.1" status: 204  len: 168 time: 0.1603200
May 31 16:28:36.172572 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:28:37.899280 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:38.226812 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-aa9b7fe7-5a93-4599-bc9a-dbba17661264 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:39.176646 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:40.885255 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:49.698703 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:55.669948 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 37950) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:28:55.787511 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4b6c61f7-86bc-4f60-9d29-b17311a8ec8e admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:55.801956 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-4b6c61f7-86bc-4f60-9d29-b17311a8ec8e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:28:55.805881 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-4b6c61f7-86bc-4f60-9d29-b17311a8ec8e admin admin] Usage tracker for resource:security_group_rule and tenant:f95c3390520b4a97a92f04770afb6f99 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:28:55.808697 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-4b6c61f7-86bc-4f60-9d29-b17311a8ec8e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:28:55.814357 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-4b6c61f7-86bc-4f60-9d29-b17311a8ec8e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:28:55.903355 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4b6c61f7-86bc-4f60-9d29-b17311a8ec8e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:55.907243 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-4b6c61f7-86bc-4f60-9d29-b17311a8ec8e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:55.916384 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d87fadf9-4f61-4c44-8bde-5e06307a0187 tempest-TestMinimumBasicScenario-1347733928 tempest-TestMinimumBasicScenario-1347733928-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:28:55.956183 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-4b6c61f7-86bc-4f60-9d29-b17311a8ec8e admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=f95c3390520b4a97a92f04770afb6f99&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2851894
May 31 16:28:55.958371 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b6c61f7-86bc-4f60-9d29-b17311a8ec8e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b03b7313-5684-42aa-87ca-a97e3eaaea14,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:28:55.959541 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 37958) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:28:55.961795 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-4b6c61f7-86bc-4f60-9d29-b17311a8ec8e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:28:56.021697 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-33ba0adc-631f-446a-81cb-06935536e624 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:56.047477 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-33ba0adc-631f-446a-81cb-06935536e624 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:56.102690 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-33ba0adc-631f-446a-81cb-06935536e624 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:56.106413 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:28:56.119355 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33ba0adc-631f-446a-81cb-06935536e624 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b03b7313-5684-42aa-87ca-a97e3eaaea14,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:28:56.130875 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ba0adc-631f-446a-81cb-06935536e624 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:56.131260 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ba0adc-631f-446a-81cb-06935536e624 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:56.131636 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ba0adc-631f-446a-81cb-06935536e624 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:56.132008 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ba0adc-631f-446a-81cb-06935536e624 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:56.132382 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ba0adc-631f-446a-81cb-06935536e624 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:56.132747 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ba0adc-631f-446a-81cb-06935536e624 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:56.133109 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ba0adc-631f-446a-81cb-06935536e624 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:56.133471 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ba0adc-631f-446a-81cb-06935536e624 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:56.133860 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ba0adc-631f-446a-81cb-06935536e624 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:56.134221 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ba0adc-631f-446a-81cb-06935536e624 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:56.134576 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ba0adc-631f-446a-81cb-06935536e624 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:56.134932 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33ba0adc-631f-446a-81cb-06935536e624 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:28:56.138115 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-33ba0adc-631f-446a-81cb-06935536e624 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:28:56.139540 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-33ba0adc-631f-446a-81cb-06935536e624 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:28:56.140641 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-33ba0adc-631f-446a-81cb-06935536e624 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/b03b7313-5684-42aa-87ca-a97e3eaaea14 HTTP/1.1" status: 204  len: 168 time: 0.1801353
May 31 16:29:05.012203 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-99a47c27-28ae-4866-8f06-a9425724906f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:07.902039 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:08.231661 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-776031d8-ff29-4ce2-9f47-3b562797718b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:09.114189 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f66b8ba7-a2d3-44a7-88c2-9f3190eede9c req-f379b41b-e652-447d-9d39-91e56a11bcb7 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:09.115736 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f66b8ba7-a2d3-44a7-88c2-9f3190eede9c req-f379b41b-e652-447d-9d39-91e56a11bcb7 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.0865014
May 31 16:29:09.162568 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f66b8ba7-a2d3-44a7-88c2-9f3190eede9c req-b7031113-b0c1-48d6-9970-4e3ca00868a6 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0410762
May 31 16:29:09.178507 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:10.468950 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66457539-cd2d-4ee1-8a1a-e33bfc03fb18 req-8b774726-4dcc-4064-9990-7e21866341f7 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:10.472092 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-66457539-cd2d-4ee1-8a1a-e33bfc03fb18 req-8b774726-4dcc-4064-9990-7e21866341f7 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.1939788
May 31 16:29:10.523413 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-66457539-cd2d-4ee1-8a1a-e33bfc03fb18 req-1de24bf7-5955-4de6-96bf-a13b8c5980dc tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0450261
May 31 16:29:10.888168 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:11.712553 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92c08e07-54a9-4242-a3bb-ac7b59c47d09 req-eb721f60-58f8-4377-b7bb-c14d11963562 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:11.714034 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-92c08e07-54a9-4242-a3bb-ac7b59c47d09 req-eb721f60-58f8-4377-b7bb-c14d11963562 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.0811288
May 31 16:29:11.763926 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-92c08e07-54a9-4242-a3bb-ac7b59c47d09 req-87ba8d1b-f1de-443b-986d-e23c8b6a8133 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0442371
May 31 16:29:12.952880 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc4b283e-d8b9-4de5-a868-f0f4993dc460 req-78bb326f-f6a7-44f8-bf7a-ead4b9f1d2df tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:12.954371 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-fc4b283e-d8b9-4de5-a868-f0f4993dc460 req-78bb326f-f6a7-44f8-bf7a-ead4b9f1d2df tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.0831258
May 31 16:29:13.002214 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-fc4b283e-d8b9-4de5-a868-f0f4993dc460 req-64ee83f4-709d-42f6-8119-7ba4bd0bd499 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0418797
May 31 16:29:13.172240 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:29:14.193852 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df4476c4-f498-4c0b-a4ab-64ee69260884 req-2b74d2ae-2921-41ae-b7b7-0bb1930401d9 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:14.195318 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-df4476c4-f498-4c0b-a4ab-64ee69260884 req-2b74d2ae-2921-41ae-b7b7-0bb1930401d9 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.0870895
May 31 16:29:14.240247 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-df4476c4-f498-4c0b-a4ab-64ee69260884 req-24f74b1a-1174-418f-950d-94b95f14dac1 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390847
May 31 16:29:15.452253 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-536dc514-8169-4cb4-8784-4077c29c792e req-0d904fd1-6312-4f74-b4df-8a04b96b8092 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:15.453618 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-536dc514-8169-4cb4-8784-4077c29c792e req-0d904fd1-6312-4f74-b4df-8a04b96b8092 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.0847795
May 31 16:29:15.498619 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-536dc514-8169-4cb4-8784-4077c29c792e req-f1d0f9ab-9824-41f5-97d0-c045cd5baf27 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0386918
May 31 16:29:16.700011 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85c1e7d2-de2d-43bb-94b0-dac1bd1c4219 req-29a7690a-3577-4b74-94fb-bfe3802fa772 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:16.701465 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-85c1e7d2-de2d-43bb-94b0-dac1bd1c4219 req-29a7690a-3577-4b74-94fb-bfe3802fa772 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.0904453
May 31 16:29:16.747979 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-85c1e7d2-de2d-43bb-94b0-dac1bd1c4219 req-9e855209-728f-4812-b8da-583852e8d335 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0405893
May 31 16:29:17.727150 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7679cc6-fe82-44a8-abbf-1ed9e7a412eb req-3e89c0fe-d7bc-40f2-b0e6-cebc0384fa76 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:17.728617 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d7679cc6-fe82-44a8-abbf-1ed9e7a412eb req-3e89c0fe-d7bc-40f2-b0e6-cebc0384fa76 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=6a420bce-c94a-4465-908e-a4e285a98869 HTTP/1.1" status: 200  len: 946 time: 0.0817976
May 31 16:29:17.778326 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d7679cc6-fe82-44a8-abbf-1ed9e7a412eb req-12e7c0e4-4830-4b0d-a264-f35d7712a3ad tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=262b9ced-321b-4d26-bfbf-d4122b5b4b61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0438893
May 31 16:29:18.007396 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d819cee7-7b7f-4866-baef-f89555f545d7 req-74fa25dd-8be3-43f3-ac76-db5378a7af18 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:18.008924 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d819cee7-7b7f-4866-baef-f89555f545d7 req-74fa25dd-8be3-43f3-ac76-db5378a7af18 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.1497703
May 31 16:29:18.032931 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c44d474-4658-4aaa-821d-4bf2626b73e2 req-4e7e5a0e-583f-4808-8832-ceda2bda7114 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:18.034373 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6c44d474-4658-4aaa-821d-4bf2626b73e2 req-4e7e5a0e-583f-4808-8832-ceda2bda7114 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=ff0bbba58394409987a388bb38868b4e&device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 1099 time: 0.1188424
May 31 16:29:18.087736 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d819cee7-7b7f-4866-baef-f89555f545d7 req-6206034e-f4ba-4ec9-bacf-90f0a91e628a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0726328
May 31 16:29:18.201542 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c44d474-4658-4aaa-821d-4bf2626b73e2 req-3ee71d8d-93f5-4c2b-a090-d621f1418a80 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:18.202996 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6c44d474-4658-4aaa-821d-4bf2626b73e2 req-3ee71d8d-93f5-4c2b-a090-d621f1418a80 service neutron] 10.222.0.63 "GET /v2.0/networks?id=0e202b3d-d60d-481f-bf3a-e31943668c98 HTTP/1.1" status: 200  len: 909 time: 0.1457350
May 31 16:29:18.312450 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6c44d474-4658-4aaa-821d-4bf2626b73e2 req-0cb73c08-33bb-4fe3-a6ec-e847551972aa service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=e42a29cb-c29c-41f8-9cfb-6379c167a596 HTTP/1.1" status: 200  len: 1001 time: 0.1020980
May 31 16:29:18.379668 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c44d474-4658-4aaa-821d-4bf2626b73e2 req-9709c084-675c-423b-bf78-71487caaf16c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:18.382605 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6c44d474-4658-4aaa-821d-4bf2626b73e2 req-9709c084-675c-423b-bf78-71487caaf16c service neutron] 10.222.0.63 "GET /v2.0/subnets?id=20f6caad-2e13-4108-af8f-f9c2336ccde2 HTTP/1.1" status: 200  len: 847 time: 0.0630391
May 31 16:29:18.460824 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c44d474-4658-4aaa-821d-4bf2626b73e2 req-5315962c-d045-448c-9c08-50c2ef451361 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:18.462293 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6c44d474-4658-4aaa-821d-4bf2626b73e2 req-5315962c-d045-448c-9c08-50c2ef451361 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=0e202b3d-d60d-481f-bf3a-e31943668c98&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0727932
May 31 16:29:18.611154 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6c44d474-4658-4aaa-821d-4bf2626b73e2 req-f128e7d6-5b2e-4bea-8d84-e554f4b140e1 service neutron] 10.222.0.63 "GET /v2.0/networks/0e202b3d-d60d-481f-bf3a-e31943668c98?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1403205
May 31 16:29:18.747051 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-6c44d474-4658-4aaa-821d-4bf2626b73e2 req-ec57a006-1b80-4645-9083-70864f39199f service neutron] 10.222.0.63 "GET /v2.0/networks/0e202b3d-d60d-481f-bf3a-e31943668c98?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1281099
May 31 16:29:18.968840 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67507745-a4e8-4452-b4a7-a08eb5a8e51f req-d7eebba9-dd27-4976-ad28-54ed888b7619 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:18.970766 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-67507745-a4e8-4452-b4a7-a08eb5a8e51f req-d7eebba9-dd27-4976-ad28-54ed888b7619 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=6a420bce-c94a-4465-908e-a4e285a98869 HTTP/1.1" status: 200  len: 946 time: 0.0833027
May 31 16:29:19.017305 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-67507745-a4e8-4452-b4a7-a08eb5a8e51f req-ad565846-5137-4534-a103-3fe71d80b888 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=262b9ced-321b-4d26-bfbf-d4122b5b4b61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0399132
May 31 16:29:19.277978 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8bff28d-7d79-4cb4-8d89-69cb21873839 req-78739061-c3c3-4f72-99b1-9bf59a73ce9f tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:19.279369 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d8bff28d-7d79-4cb4-8d89-69cb21873839 req-78739061-c3c3-4f72-99b1-9bf59a73ce9f tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.0839312
May 31 16:29:19.473160 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d8bff28d-7d79-4cb4-8d89-69cb21873839 req-894d7dfd-4d12-4c7c-899c-5625c8b4894a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1882024
May 31 16:29:19.516635 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63c70959-884d-4dd2-a2f7-ebfaab6d0da1 req-b832564a-ccfd-4a9c-9b73-19f8ba0b0e2f tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:19.518072 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-63c70959-884d-4dd2-a2f7-ebfaab6d0da1 req-b832564a-ccfd-4a9c-9b73-19f8ba0b0e2f tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.63 "GET /v2.0/ports?device_id=6a420bce-c94a-4465-908e-a4e285a98869 HTTP/1.1" status: 200  len: 946 time: 0.0930359
May 31 16:29:19.568899 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 38206) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:19.661921 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [req-63c70959-884d-4dd2-a2f7-ebfaab6d0da1 req-2de8536f-4688-4c99-b0bd-fbc83fcae673 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Deleting port 44642665-875e-4063-a715-b66d023bc8e7 {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:29:19.662262 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-63c70959-884d-4dd2-a2f7-ebfaab6d0da1 req-2de8536f-4688-4c99-b0bd-fbc83fcae673 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:19.695620 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:19.716757 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:29:19.720951 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Usage tracker for resource:security_group_rule and tenant:18cd7ddb55ac4a06a3b208ecb8b59ec2 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:29:19.723958 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:29:19.730477 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:29:19.731519 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:19.804149 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-63c70959-884d-4dd2-a2f7-ebfaab6d0da1 req-2de8536f-4688-4c99-b0bd-fbc83fcae673 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] For port 44642665-875e-4063-a715-b66d023bc8e7, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=44642665-875e-4063-a715-b66d023bc8e7,segment=NetworkSegment(1974822a-78ff-4607-935a-c9f5ba4a898d),segment_id=1974822a-78ff-4607-935a-c9f5ba4a898d)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:29:19.804781 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-63c70959-884d-4dd2-a2f7-ebfaab6d0da1 req-2de8536f-4688-4c99-b0bd-fbc83fcae673 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:19.816250 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:19.820801 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:19.828078 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-8a76f1fb-1872-4e69-b9be-a9c260889dc6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:19.870250 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=18cd7ddb55ac4a06a3b208ecb8b59ec2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3002439
May 31 16:29:19.871190 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7e576cdd-2219-4f4e-a848-50c9e13c3834,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:19.873190 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 38212) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:19.891232 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:19.891619 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:19.891998 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:19.892378 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:19.892745 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:19.893114 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:19.893480 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:19.893871 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:19.894235 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:19.894595 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:19.894954 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:19.895316 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:19.901041 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:19.947663 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-68fb9959-498a-4c80-a3c9-25ec3db6738d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:19.976336 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-68fb9959-498a-4c80-a3c9-25ec3db6738d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:20.035008 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-68fb9959-498a-4c80-a3c9-25ec3db6738d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:20.040261 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-3f501637-ea91-47aa-947e-02d3fb3fae7d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:20.056734 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68fb9959-498a-4c80-a3c9-25ec3db6738d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e576cdd-2219-4f4e-a848-50c9e13c3834,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:20.060951 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-68fb9959-498a-4c80-a3c9-25ec3db6738d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:20.090494 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-68fb9959-498a-4c80-a3c9-25ec3db6738d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:20.094235 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-68fb9959-498a-4c80-a3c9-25ec3db6738d admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/7e576cdd-2219-4f4e-a848-50c9e13c3834 HTTP/1.1" status: 204  len: 168 time: 0.2178261
May 31 16:29:20.112551 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-63c70959-884d-4dd2-a2f7-ebfaab6d0da1 req-2de8536f-4688-4c99-b0bd-fbc83fcae673 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:20.113008 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-63c70959-884d-4dd2-a2f7-ebfaab6d0da1 req-2de8536f-4688-4c99-b0bd-fbc83fcae673 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16621821'] for floatingip, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:20.113334 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.db.l3_db [req-63c70959-884d-4dd2-a2f7-ebfaab6d0da1 req-2de8536f-4688-4c99-b0bd-fbc83fcae673 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Floating IP 74ce6971-6765-48e0-b2f2-855bd8869e45 disassociated. External IP: 172.27.0.228, port: 44642665-875e-4063-a715-b66d023bc8e7.
May 31 16:29:20.113953 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [req-63c70959-884d-4dd2-a2f7-ebfaab6d0da1 req-2de8536f-4688-4c99-b0bd-fbc83fcae673 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Calling delete_port for 44642665-875e-4063-a715-b66d023bc8e7 owned by compute:nova {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:29:20.301462 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d0f6cc4-5592-474c-9947-8198fe4a7ad3 req-1c55b79d-2b2b-4070-b58b-ff9d38634456 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:20.303036 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9d0f6cc4-5592-474c-9947-8198fe4a7ad3 req-1c55b79d-2b2b-4070-b58b-ff9d38634456 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=6a420bce-c94a-4465-908e-a4e285a98869 HTTP/1.1" status: 200  len: 946 time: 0.1537862
May 31 16:29:20.326229 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-63c70959-884d-4dd2-a2f7-ebfaab6d0da1 req-2de8536f-4688-4c99-b0bd-fbc83fcae673 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:20.334903 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-d930ba93-8ee0-4a63-851f-7f00d4e1d068 tempest-AttachVolumeNegativeTest-2035009780 tempest-AttachVolumeNegativeTest-2035009780-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:20.402226 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2de8536f-4688-4c99-b0bd-fbc83fcae673 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Pushing event deleted for resources: {'Port': ['ID=44642665-875e-4063-a715-b66d023bc8e7,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:20.419556 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-2de8536f-4688-4c99-b0bd-fbc83fcae673 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:20.422529 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9d0f6cc4-5592-474c-9947-8198fe4a7ad3 req-ddaa3d57-05b6-44f1-9a12-848626ffd4b0 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups?id=262b9ced-321b-4d26-bfbf-d4122b5b4b61&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1134961
May 31 16:29:20.660118 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.l3_agent_scheduler [req-63c70959-884d-4dd2-a2f7-ebfaab6d0da1 req-2de8536f-4688-4c99-b0bd-fbc83fcae673 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Router 2bcd5afd-bdf4-472d-8a91-95997718441c has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91764) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:29:20.759105 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d9e181a-36b7-490d-a1ca-521304f27622 req-46f361f5-c120-4a8f-b3be-ef33382664c6 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:20.760626 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0d9e181a-36b7-490d-a1ca-521304f27622 req-46f361f5-c120-4a8f-b3be-ef33382664c6 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.1788988
May 31 16:29:20.891956 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0d9e181a-36b7-490d-a1ca-521304f27622 req-d1e6124a-f90d-4387-812e-c8b453acac52 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1181135
May 31 16:29:20.909644 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-63c70959-884d-4dd2-a2f7-ebfaab6d0da1 req-2de8536f-4688-4c99-b0bd-fbc83fcae673 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91764) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:29:20.921257 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e671decf-fe32-4885-a7da-15f908890ffd None None] Sync routers for ids ['2bcd5afd-bdf4-472d-8a91-95997718441c'] in dv-cinder-793814-1-iscsi {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:29:20.930809 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e671decf-fe32-4885-a7da-15f908890ffd None None] Routers {'2bcd5afd-bdf4-472d-8a91-95997718441c'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:29:20.931428 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-e671decf-fe32-4885-a7da-15f908890ffd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426e6b280>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:29:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['2bcd5afd-bdf4-472d-8a91-95997718441c'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:21.100517 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [req-63c70959-884d-4dd2-a2f7-ebfaab6d0da1 req-2de8536f-4688-4c99-b0bd-fbc83fcae673 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] No DVR routers for this DVR port 44642665-875e-4063-a715-b66d023bc8e7 on host hv-cinder-79381 {{(pid=91764) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:29:21.103174 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-63c70959-884d-4dd2-a2f7-ebfaab6d0da1 req-2de8536f-4688-4c99-b0bd-fbc83fcae673 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:21.107430 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6a420bce-c94a-4465-908e-a4e285a98869', 'name': 'network-vif-deleted', 'tag': '44642665-875e-4063-a715-b66d023bc8e7'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:29:21.109757 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7ca9cac9-5adf-48e3-8c4d-04dae57eb6ed" -d '{"events": [{"server_uuid": "6a420bce-c94a-4465-908e-a4e285a98869", "name": "network-vif-deleted", "tag": "44642665-875e-4063-a715-b66d023bc8e7"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:29:21.124003 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-e671decf-fe32-4885-a7da-15f908890ffd None None] Set router 2bcd5afd-bdf4-472d-8a91-95997718441c gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:29:21.128373 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-63c70959-884d-4dd2-a2f7-ebfaab6d0da1 req-2de8536f-4688-4c99-b0bd-fbc83fcae673 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.63 "DELETE /v2.0/ports/44642665-875e-4063-a715-b66d023bc8e7 HTTP/1.1" status: 204  len: 173 time: 1.6029475
May 31 16:29:21.177564 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:29:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ed832ac1-78f8-4382-9ba5-5cb7b2793016 x-openstack-request-id: req-ed832ac1-78f8-4382-9ba5-5cb7b2793016 {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:29:21.177795 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6a420bce-c94a-4465-908e-a4e285a98869", "name": "network-vif-deleted", "tag": "44642665-875e-4063-a715-b66d023bc8e7", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:29:21.178158 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-ed832ac1-78f8-4382-9ba5-5cb7b2793016 {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:29:21.178757 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6a420bce-c94a-4465-908e-a4e285a98869', 'name': 'network-vif-deleted', 'tag': '44642665-875e-4063-a715-b66d023bc8e7', 'status': 'completed', 'code': 200}
May 31 16:29:21.483296 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-e671decf-fe32-4885-a7da-15f908890ffd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426e6b280>, [{'id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:24:01Z', 'updated_at': '2021-05-31T16:24:06Z', 'revision_number': 4, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'gw_port': {'id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:d3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 468, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:02Z', 'updated_at': '2021-05-31T16:24:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '729c3966-0f99-4a7d-ab46-eadab5d24529', 'name': '', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'mac_address': 'fa:16:3e:23:3b:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_interface', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:04Z', 'updated_at': '2021-05-31T16:24:10Z', 'revision_number': 5, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'subnets': [{'id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:21.487206 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e671decf-fe32-4885-a7da-15f908890ffd None None] Checking router: 2bcd5afd-bdf4-472d-8a91-95997718441c for host: dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:29:21.496409 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e671decf-fe32-4885-a7da-15f908890ffd None None] Routers {'2bcd5afd-bdf4-472d-8a91-95997718441c'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:29:21.497028 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-e671decf-fe32-4885-a7da-15f908890ffd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426e6b280>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:29:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['2bcd5afd-bdf4-472d-8a91-95997718441c'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:21.628245 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-5597d361-697b-4ab3-93c8-28cfae7cd9ef req-7ad883b2-e032-4571-b0b8-3db9f31a3088 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Synchronizing usage tracker for tenant:a56002dfed61485aa4d9e237932e1abf on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:29:21.651345 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-5597d361-697b-4ab3-93c8-28cfae7cd9ef req-7ad883b2-e032-4571-b0b8-3db9f31a3088 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Unset dirty status for tenant:a56002dfed61485aa4d9e237932e1abf on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:29:21.661234 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5597d361-697b-4ab3-93c8-28cfae7cd9ef req-7ad883b2-e032-4571-b0b8-3db9f31a3088 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/ports?device_id=6a420bce-c94a-4465-908e-a4e285a98869 HTTP/1.1" status: 200  len: 210 time: 0.0819240
May 31 16:29:21.695354 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-e671decf-fe32-4885-a7da-15f908890ffd None None] Set router 2bcd5afd-bdf4-472d-8a91-95997718441c gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:29:22.036002 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-e671decf-fe32-4885-a7da-15f908890ffd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426e6b280>, [{'id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:24:01Z', 'updated_at': '2021-05-31T16:24:06Z', 'revision_number': 4, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'gw_port': {'id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:d3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 468, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:02Z', 'updated_at': '2021-05-31T16:24:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '729c3966-0f99-4a7d-ab46-eadab5d24529', 'name': '', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'mac_address': 'fa:16:3e:23:3b:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_interface', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:04Z', 'updated_at': '2021-05-31T16:24:10Z', 'revision_number': 5, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'subnets': [{'id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:22.040399 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e671decf-fe32-4885-a7da-15f908890ffd None None] The sync data for ids ['2bcd5afd-bdf4-472d-8a91-95997718441c'] in dv-cinder-793814-1-iscsi is: [{'id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:24:01Z', 'updated_at': '2021-05-31T16:24:06Z', 'revision_number': 4, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'gw_port': {'id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:d3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 468, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:02Z', 'updated_at': '2021-05-31T16:24:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '729c3966-0f99-4a7d-ab46-eadab5d24529', 'name': '', 'network_id': 'cd1ac218-ff8f-46e5-91e3-f1ff613f07d5', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'mac_address': 'fa:16:3e:23:3b:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_interface', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:04Z', 'updated_at': '2021-05-31T16:24:10Z', 'revision_number': 5, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'subnets': [{'id': '6489943b-1236-4d7c-80a7-58ef5aedf09d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:29:22.107148 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c899d3cb-f2de-461d-b6bc-5ac2abf27a24 req-abb56566-6249-4af2-8b99-597e81369fdf tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:22.108673 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c899d3cb-f2de-461d-b6bc-5ac2abf27a24 req-abb56566-6249-4af2-8b99-597e81369fdf tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.0964394
May 31 16:29:22.160963 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c899d3cb-f2de-461d-b6bc-5ac2abf27a24 req-51570cd5-46eb-403e-8821-b64aa4ec648a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0463488
May 31 16:29:22.283254 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa00177b-857c-4adf-848a-46a5a2caf0fe None None] New status for floating IP 74ce6971-6765-48e0-b2f2-855bd8869e45: DOWN {{(pid=91765) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 31 16:29:22.775433 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 38312) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:22.843800 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-07867e87-a75c-4350-b686-feb2d958fafb tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:22.874643 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-07867e87-a75c-4350-b686-feb2d958fafb tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:22.934146 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-07867e87-a75c-4350-b686-feb2d958fafb tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:22.938608 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e94f9991-95e4-4691-ae00-d744648a3a2f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:22.952945 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07867e87-a75c-4350-b686-feb2d958fafb tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=262b9ced-321b-4d26-bfbf-d4122b5b4b61,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:22.955508 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-07867e87-a75c-4350-b686-feb2d958fafb tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:22.964136 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-07867e87-a75c-4350-b686-feb2d958fafb tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:22.965242 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-07867e87-a75c-4350-b686-feb2d958fafb tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "DELETE /v2.0/security-groups/262b9ced-321b-4d26-bfbf-d4122b5b4b61 HTTP/1.1" status: 204  len: 168 time: 0.1888263
May 31 16:29:22.967898 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 38316) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:22.985400 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.api.v2.resource [None req-ee4cc928-adf9-497d-8079-31a104ff4d03 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] show failed (client error): The resource could not be found.
May 31 16:29:22.986431 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-ee4cc928-adf9-497d-8079-31a104ff4d03 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "GET /v2.0/security-groups/262b9ced-321b-4d26-bfbf-d4122b5b4b61 HTTP/1.1" status: 404  len: 347 time: 0.0176377
May 31 16:29:22.989353 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 38320) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:23.222350 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-6e08d9ce-5893-41e4-a3bf-bb77e8485052 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Deleting port da6def5b-4ec4-4d2d-b6a6-d3e6b5071783 {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:29:23.222700 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6e08d9ce-5893-41e4-a3bf-bb77e8485052 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:23.346452 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6e08d9ce-5893-41e4-a3bf-bb77e8485052 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:23.346790 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6e08d9ce-5893-41e4-a3bf-bb77e8485052 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:23.359882 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aea15cb-b739-4c86-814e-9d853f7369b3 req-cc01a9ba-a170-4afc-97b8-bc495620647a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:23.361751 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5aea15cb-b739-4c86-814e-9d853f7369b3 req-cc01a9ba-a170-4afc-97b8-bc495620647a tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.0856333
May 31 16:29:23.410265 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5aea15cb-b739-4c86-814e-9d853f7369b3 req-4842d9d5-cb04-4c58-82dc-ed014be32571 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0426810
May 31 16:29:23.561208 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-6e08d9ce-5893-41e4-a3bf-bb77e8485052 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Calling delete_port for da6def5b-4ec4-4d2d-b6a6-d3e6b5071783 owned by network:floatingip {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:29:23.670567 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6e08d9ce-5893-41e4-a3bf-bb77e8485052 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:23.674104 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-63a4454c-e324-42f2-bc41-a0cd908159cd tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:23.718258 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e08d9ce-5893-41e4-a3bf-bb77e8485052 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Pushing event deleted for resources: {'Port': ['ID=da6def5b-4ec4-4d2d-b6a6-d3e6b5071783,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:23.721662 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-6e08d9ce-5893-41e4-a3bf-bb77e8485052 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:23.762299 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 44642665-875e-4063-a715-b66d023bc8e7 no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:29:23.798907 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] No Port match for: 44642665-875e-4063-a715-b66d023bc8e7 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:29:23.799290 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 44642665-875e-4063-a715-b66d023bc8e7 not bound to the agent host hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:29:23.814897 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6e08d9ce-5893-41e4-a3bf-bb77e8485052 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks [] for floatingip, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:23.836961 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6e08d9ce-5893-41e4-a3bf-bb77e8485052 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for floatingip, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:23.838131 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-6e08d9ce-5893-41e4-a3bf-bb77e8485052 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] 10.222.0.43 "DELETE /v2.0/floatingips/74ce6971-6765-48e0-b2f2-855bd8869e45 HTTP/1.1" status: 204  len: 168 time: 0.8476806
May 31 16:29:24.193231 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f6308fd-b18f-4009-ade1-c48e0bb078fb req-2154f82d-98b7-4928-872f-e475c1897b7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:24.194776 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1f6308fd-b18f-4009-ade1-c48e0bb078fb req-2154f82d-98b7-4928-872f-e475c1897b7d service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=ff0bbba58394409987a388bb38868b4e&device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 1099 time: 0.0780990
May 31 16:29:24.339198 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f6308fd-b18f-4009-ade1-c48e0bb078fb req-13a51273-98e3-45f4-98c1-0564824e6dd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:24.340889 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1f6308fd-b18f-4009-ade1-c48e0bb078fb req-13a51273-98e3-45f4-98c1-0564824e6dd9 service neutron] 10.222.0.63 "GET /v2.0/networks?id=0e202b3d-d60d-481f-bf3a-e31943668c98 HTTP/1.1" status: 200  len: 909 time: 0.1390815
May 31 16:29:24.446394 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1f6308fd-b18f-4009-ade1-c48e0bb078fb req-56eacf27-067f-48d2-b093-d2ed2ed07aa5 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=e42a29cb-c29c-41f8-9cfb-6379c167a596 HTTP/1.1" status: 200  len: 1001 time: 0.0977874
May 31 16:29:24.512491 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f6308fd-b18f-4009-ade1-c48e0bb078fb req-325246ee-09e7-4f4f-802a-b77afb037597 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:24.513969 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1f6308fd-b18f-4009-ade1-c48e0bb078fb req-325246ee-09e7-4f4f-802a-b77afb037597 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=20f6caad-2e13-4108-af8f-f9c2336ccde2 HTTP/1.1" status: 200  len: 847 time: 0.0608494
May 31 16:29:24.656188 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f6308fd-b18f-4009-ade1-c48e0bb078fb req-7843c977-ce93-4676-918c-a45de4cc9329 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:24.657678 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1f6308fd-b18f-4009-ade1-c48e0bb078fb req-7843c977-ce93-4676-918c-a45de4cc9329 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=0e202b3d-d60d-481f-bf3a-e31943668c98&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1366382
May 31 16:29:24.665697 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20530035-c3de-4c59-b9e1-0cc731fbc966 req-ab02ed68-b097-481a-9486-70dfcda44588 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:24.667021 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-20530035-c3de-4c59-b9e1-0cc731fbc966 req-ab02ed68-b097-481a-9486-70dfcda44588 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.1119366
May 31 16:29:24.792947 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-20530035-c3de-4c59-b9e1-0cc731fbc966 req-5596eb09-1124-4f92-9501-19fc75945205 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1074622
May 31 16:29:24.832631 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1f6308fd-b18f-4009-ade1-c48e0bb078fb req-a3384c88-5616-4d20-8339-d3e5f130923a service neutron] 10.222.0.63 "GET /v2.0/networks/0e202b3d-d60d-481f-bf3a-e31943668c98?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1646779
May 31 16:29:24.969869 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1f6308fd-b18f-4009-ade1-c48e0bb078fb req-51da7b03-ffd1-441e-afec-5360c4e09cad service neutron] 10.222.0.63 "GET /v2.0/networks/0e202b3d-d60d-481f-bf3a-e31943668c98?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1307542
May 31 16:29:25.620525 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 38346) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:25.896447 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-f6351b9f-8175-4747-b8f3-9e60d061337c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Deleting port a36be541-ee07-4d66-bbb9-9c950584b8d0 {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:29:25.896683 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-f6351b9f-8175-4747-b8f3-9e60d061337c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:25.990818 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bdf34a6-82bf-480f-bbea-3572bb4713f0 req-10781b61-748f-4add-a4a8-13df28ad2985 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:25.992323 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9bdf34a6-82bf-480f-bbea-3572bb4713f0 req-10781b61-748f-4add-a4a8-13df28ad2985 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.0868700
May 31 16:29:26.023952 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-f6351b9f-8175-4747-b8f3-9e60d061337c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:26.024283 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-f6351b9f-8175-4747-b8f3-9e60d061337c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:26.042178 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9bdf34a6-82bf-480f-bbea-3572bb4713f0 req-e19c449d-645a-4fa2-88be-92de9536d10d tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0435612
May 31 16:29:26.150639 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-f6351b9f-8175-4747-b8f3-9e60d061337c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Calling delete_port for a36be541-ee07-4d66-bbb9-9c950584b8d0 owned by network:floatingip {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:29:26.281972 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-f6351b9f-8175-4747-b8f3-9e60d061337c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:26.287405 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-81ca36a1-3c56-4838-9979-1ee2ece2a1ef tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:26.331165 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6351b9f-8175-4747-b8f3-9e60d061337c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Pushing event deleted for resources: {'Port': ['ID=a36be541-ee07-4d66-bbb9-9c950584b8d0,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:26.335724 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-f6351b9f-8175-4747-b8f3-9e60d061337c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:26.430076 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-f6351b9f-8175-4747-b8f3-9e60d061337c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for floatingip, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:26.430417 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.l3_db [None req-f6351b9f-8175-4747-b8f3-9e60d061337c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Floating IP 4cfa0151-ec70-4a38-950b-45cdd617fd1a disassociated (deleted). External IP: 172.27.0.15, port: 31d7a0be-14fe-4eee-8a37-db20d72be4ab.
May 31 16:29:26.910052 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f6351b9f-8175-4747-b8f3-9e60d061337c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Router 80126872-1960-4f13-9ca2-0eaf66181e32 has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91763) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:29:27.105627 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f6351b9f-8175-4747-b8f3-9e60d061337c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:29:27.122651 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0adf36a-9cf4-4267-a476-8f2dfdb8473d None None] Sync routers for ids ['80126872-1960-4f13-9ca2-0eaf66181e32'] in dv-cinder-793814-1-iscsi {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:29:27.123723 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-f6351b9f-8175-4747-b8f3-9e60d061337c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for floatingip, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:27.142013 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0adf36a-9cf4-4267-a476-8f2dfdb8473d None None] Routers {'80126872-1960-4f13-9ca2-0eaf66181e32'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:29:27.143140 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-b0adf36a-9cf4-4267-a476-8f2dfdb8473d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426b5c1f0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:29:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['80126872-1960-4f13-9ca2-0eaf66181e32'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:27.196921 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-f6351b9f-8175-4747-b8f3-9e60d061337c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "DELETE /v2.0/floatingips/4cfa0151-ec70-4a38-950b-45cdd617fd1a HTTP/1.1" status: 204  len: 168 time: 1.5651672
May 31 16:29:27.199479 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa', 'tag': '31d7a0be-14fe-4eee-8a37-db20d72be4ab'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:29:27.201891 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4a99c42e-17e3-4b59-930e-a4bf238fb318" -d '{"events": [{"name": "network-changed", "server_uuid": "4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa", "tag": "31d7a0be-14fe-4eee-8a37-db20d72be4ab"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:29:27.274492 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0113c20a-91f6-4228-9fc1-220e6c5d3f15 req-5a6766cf-9606-4438-85bf-1b2b8746ff50 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:27.277204 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0113c20a-91f6-4228-9fc1-220e6c5d3f15 req-5a6766cf-9606-4438-85bf-1b2b8746ff50 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.0917404
May 31 16:29:27.331122 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0113c20a-91f6-4228-9fc1-220e6c5d3f15 req-8930415e-e5ef-4504-a17d-4c55ada6c8d2 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0477128
May 31 16:29:27.385494 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-b0adf36a-9cf4-4267-a476-8f2dfdb8473d None None] Set router 80126872-1960-4f13-9ca2-0eaf66181e32 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:29:27.408202 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:29:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f3f65f15-5f44-4377-a133-c9cdfd82e79d x-openstack-request-id: req-f3f65f15-5f44-4377-a133-c9cdfd82e79d {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:29:27.408650 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa", "tag": "31d7a0be-14fe-4eee-8a37-db20d72be4ab", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:29:27.409024 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-f3f65f15-5f44-4377-a133-c9cdfd82e79d {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:29:27.409541 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa', 'tag': '31d7a0be-14fe-4eee-8a37-db20d72be4ab', 'status': 'completed', 'code': 200}
May 31 16:29:27.524213 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a99c42e-17e3-4b59-930e-a4bf238fb318 req-84bf7b43-f29b-4295-a7be-8b46d8644a4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:27.526555 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4a99c42e-17e3-4b59-930e-a4bf238fb318 req-84bf7b43-f29b-4295-a7be-8b46d8644a4f service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=092115f69b8e401b8c334f7b3e797aad&device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 1098 time: 0.0941637
May 31 16:29:27.715002 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-b0adf36a-9cf4-4267-a476-8f2dfdb8473d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426b5c1f0>, [{'id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229'}], 'enable_snat': True}, 'gw_port_id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:05Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 4, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'gw_port': {'id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:b8:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:06Z', 'updated_at': '2021-05-31T16:21:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '27a83f61-e253-4ba1-954c-e810e9a33917', 'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'mac_address': 'fa:16:3e:fc:8a:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_interface', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:09Z', 'updated_at': '2021-05-31T16:21:20Z', 'revision_number': 5, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'subnets': [{'id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:27.719488 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0adf36a-9cf4-4267-a476-8f2dfdb8473d None None] Checking router: 80126872-1960-4f13-9ca2-0eaf66181e32 for host: dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:29:27.729768 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0adf36a-9cf4-4267-a476-8f2dfdb8473d None None] Routers {'80126872-1960-4f13-9ca2-0eaf66181e32'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:29:27.730537 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-b0adf36a-9cf4-4267-a476-8f2dfdb8473d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426b5c1f0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:29:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['80126872-1960-4f13-9ca2-0eaf66181e32'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:27.732760 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8946eee-ab8a-4f7b-b617-885e8e659899 req-db9ae918-c093-4842-9ba6-7a3fcf71b84d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:27.734296 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c8946eee-ab8a-4f7b-b617-885e8e659899 req-db9ae918-c093-4842-9ba6-7a3fcf71b84d tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 945 time: 0.2067983
May 31 16:29:27.737550 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a99c42e-17e3-4b59-930e-a4bf238fb318 req-b9708b48-6d94-4677-8cb5-6444361a9a5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:27.739563 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4a99c42e-17e3-4b59-930e-a4bf238fb318 req-b9708b48-6d94-4677-8cb5-6444361a9a5e service neutron] 10.222.0.63 "GET /v2.0/networks?id=5b237728-dc31-4203-bbac-66ce3db1593a HTTP/1.1" status: 200  len: 913 time: 0.1777380
May 31 16:29:27.947729 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 38380) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:27.966092 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4a99c42e-17e3-4b59-930e-a4bf238fb318 req-aef38c24-8690-4c08-b2ae-875d619e395a service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=31d7a0be-14fe-4eee-8a37-db20d72be4ab HTTP/1.1" status: 200  len: 217 time: 0.1881757
May 31 16:29:27.966758 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-b0adf36a-9cf4-4267-a476-8f2dfdb8473d None None] Set router 80126872-1960-4f13-9ca2-0eaf66181e32 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:29:27.974008 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c8946eee-ab8a-4f7b-b617-885e8e659899 req-caa164b3-e0b7-4465-a948-d6d7e17a15b5 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2333250
May 31 16:29:28.037005 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a99c42e-17e3-4b59-930e-a4bf238fb318 req-411bef5a-a9fc-428d-93ac-a698de3b0fab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:28.038673 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4a99c42e-17e3-4b59-930e-a4bf238fb318 req-411bef5a-a9fc-428d-93ac-a698de3b0fab service neutron] 10.222.0.63 "GET /v2.0/subnets?id=995d9a2e-7e88-458e-9385-d135c0e07276 HTTP/1.1" status: 200  len: 851 time: 0.0637755
May 31 16:29:28.118971 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a99c42e-17e3-4b59-930e-a4bf238fb318 req-5e4367ae-fd01-40cc-be12-7e2cb6d574b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:28.120559 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4a99c42e-17e3-4b59-930e-a4bf238fb318 req-5e4367ae-fd01-40cc-be12-7e2cb6d574b8 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=5b237728-dc31-4203-bbac-66ce3db1593a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0739915
May 31 16:29:28.278763 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4a99c42e-17e3-4b59-930e-a4bf238fb318 req-adf719b6-11e3-4fdf-bc49-b9c2ef42ae6a service neutron] 10.222.0.63 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1401868
May 31 16:29:28.329339 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-b0adf36a-9cf4-4267-a476-8f2dfdb8473d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426b5c1f0>, [{'id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229'}], 'enable_snat': True}, 'gw_port_id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:05Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 4, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'gw_port': {'id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:b8:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:06Z', 'updated_at': '2021-05-31T16:21:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '27a83f61-e253-4ba1-954c-e810e9a33917', 'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'mac_address': 'fa:16:3e:fc:8a:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_interface', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:09Z', 'updated_at': '2021-05-31T16:21:20Z', 'revision_number': 5, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'subnets': [{'id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:28.334215 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0adf36a-9cf4-4267-a476-8f2dfdb8473d None None] The sync data for ids ['80126872-1960-4f13-9ca2-0eaf66181e32'] in dv-cinder-793814-1-iscsi is: [{'id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229'}], 'enable_snat': True}, 'gw_port_id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:05Z', 'updated_at': '2021-05-31T16:21:09Z', 'revision_number': 4, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'gw_port': {'id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:b8:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:06Z', 'updated_at': '2021-05-31T16:21:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '27a83f61-e253-4ba1-954c-e810e9a33917', 'name': '', 'network_id': '5b237728-dc31-4203-bbac-66ce3db1593a', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'mac_address': 'fa:16:3e:fc:8a:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_interface', 'standard_attr_id': 269, 'fixed_ips': [{'subnet_id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:09Z', 'updated_at': '2021-05-31T16:21:20Z', 'revision_number': 5, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'subnets': [{'id': '995d9a2e-7e88-458e-9385-d135c0e07276', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:29:28.456638 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4a99c42e-17e3-4b59-930e-a4bf238fb318 req-41823b6f-c0b2-43fd-9222-9cab155ac12a service neutron] 10.222.0.63 "GET /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1701522
May 31 16:29:28.577579 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ebfb086-d8bd-4124-bfa7-aa673a29be1e req-4ebfa4d9-de35-4e06-99a8-2d77b8360f07 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:28.582213 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8ebfb086-d8bd-4124-bfa7-aa673a29be1e req-4ebfa4d9-de35-4e06-99a8-2d77b8360f07 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.1131575
May 31 16:29:28.610042 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-229c06cd-d18c-43f8-b599-3648df1830fd None None] New status for floating IP 4cfa0151-ec70-4a38-950b-45cdd617fd1a: DOWN {{(pid=91765) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 31 16:29:28.629428 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8ebfb086-d8bd-4124-bfa7-aa673a29be1e req-aa6fd269-93c8-495d-b6b4-84916e01f9da tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0428178
May 31 16:29:28.803665 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-a8a67643-8ed0-4da6-867d-e1201a14cbc1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-16627919'] for router_interface, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:28.922869 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 38398) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:29.240376 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-a8a67643-8ed0-4da6-867d-e1201a14cbc1 admin admin] Deleting port 729c3966-0f99-4a7d-ab46-eadab5d24529 {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:29:29.240940 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-a8a67643-8ed0-4da6-867d-e1201a14cbc1 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:29.254979 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d28226c-da3e-4b86-94b1-ccb6c8223023 req-3c629284-1ab3-4be9-ab6f-7df68f93abe2 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:29.256709 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5d28226c-da3e-4b86-94b1-ccb6c8223023 req-3c629284-1ab3-4be9-ab6f-7df68f93abe2 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.3267105
May 31 16:29:29.274842 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8c446601-ce4c-46a2-aeb7-602005815668 req-fd2e97d2-2e91-44c4-889e-c34b22e4e432 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.3505015
May 31 16:29:29.314085 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e525c1e-a089-4071-8644-757d98246b9c req-6b7d9eaa-bfc4-46d9-8fb8-d84bd738c79e tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:29.316454 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8e525c1e-a089-4071-8644-757d98246b9c req-6b7d9eaa-bfc4-46d9-8fb8-d84bd738c79e tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.63 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 945 time: 0.2596328
May 31 16:29:29.371180 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [None req-a8a67643-8ed0-4da6-867d-e1201a14cbc1 admin admin] For port 729c3966-0f99-4a7d-ab46-eadab5d24529, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=729c3966-0f99-4a7d-ab46-eadab5d24529,segment=NetworkSegment(1974822a-78ff-4607-935a-c9f5ba4a898d),segment_id=1974822a-78ff-4607-935a-c9f5ba4a898d)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:29:29.371662 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-a8a67643-8ed0-4da6-867d-e1201a14cbc1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:29.402233 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5d28226c-da3e-4b86-94b1-ccb6c8223023 req-00c49048-5d4d-47d1-94cb-74668eb2d88d tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1339133
May 31 16:29:29.412699 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbaae287-aef5-440c-83a5-663644e60380 req-77b248b2-f702-4bdc-aab1-e0d40e10951f tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:29.414253 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bbaae287-aef5-440c-83a5-663644e60380 req-77b248b2-f702-4bdc-aab1-e0d40e10951f tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 945 time: 0.2545476
May 31 16:29:29.518130 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bbaae287-aef5-440c-83a5-663644e60380 req-03ddb48f-2585-4500-add0-1522f719721b tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/security-groups?id=b16a6ce7-d949-48d8-8c08-03576b09b2e8&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0974483
May 31 16:29:29.547611 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [req-8e525c1e-a089-4071-8644-757d98246b9c req-10cabc4b-330b-457d-90f6-123c500ba195 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Deleting port 31d7a0be-14fe-4eee-8a37-db20d72be4ab {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:29:29.548035 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-8e525c1e-a089-4071-8644-757d98246b9c req-10cabc4b-330b-457d-90f6-123c500ba195 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:29.624595 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-a8a67643-8ed0-4da6-867d-e1201a14cbc1 admin admin] Calling delete_port for 729c3966-0f99-4a7d-ab46-eadab5d24529 owned by network:router_interface {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:29:29.689076 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-8e525c1e-a089-4071-8644-757d98246b9c req-10cabc4b-330b-457d-90f6-123c500ba195 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] For port 31d7a0be-14fe-4eee-8a37-db20d72be4ab, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=31d7a0be-14fe-4eee-8a37-db20d72be4ab,segment=NetworkSegment(fb1fd409-498f-4f29-82bc-1d244a7a3ed1),segment_id=fb1fd409-498f-4f29-82bc-1d244a7a3ed1)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:29:29.689439 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-8e525c1e-a089-4071-8644-757d98246b9c req-10cabc4b-330b-457d-90f6-123c500ba195 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:29.803915 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-a8a67643-8ed0-4da6-867d-e1201a14cbc1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:29.807722 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-4ca76515-5dd1-46e4-bc5e-0f701bac5281 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:29.835273 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [req-8e525c1e-a089-4071-8644-757d98246b9c req-10cabc4b-330b-457d-90f6-123c500ba195 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Calling delete_port for 31d7a0be-14fe-4eee-8a37-db20d72be4ab owned by compute:nova {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:29:29.852733 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8a67643-8ed0-4da6-867d-e1201a14cbc1 admin admin] Pushing event deleted for resources: {'Port': ['ID=729c3966-0f99-4a7d-ab46-eadab5d24529,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:29.905748 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-a8a67643-8ed0-4da6-867d-e1201a14cbc1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:30.015152 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-8e525c1e-a089-4071-8644-757d98246b9c req-10cabc4b-330b-457d-90f6-123c500ba195 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:30.024203 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-10337ac0-366b-4697-ad9a-ea841e307fa2 tempest-VolumesSnapshotTestJSON-1625412876 tempest-VolumesSnapshotTestJSON-1625412876-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:30.072207 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10cabc4b-330b-457d-90f6-123c500ba195 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Pushing event deleted for resources: {'Port': ['ID=31d7a0be-14fe-4eee-8a37-db20d72be4ab,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:30.080930 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-10cabc4b-330b-457d-90f6-123c500ba195 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:30.189846 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-a8a67643-8ed0-4da6-867d-e1201a14cbc1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-16317375', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-16625247'] for router_interface, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:30.279667 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [req-8e525c1e-a089-4071-8644-757d98246b9c req-10cabc4b-330b-457d-90f6-123c500ba195 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] No DVR routers for this DVR port 31d7a0be-14fe-4eee-8a37-db20d72be4ab on host hv-cinder-79381 {{(pid=91764) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:29:30.282450 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-8e525c1e-a089-4071-8644-757d98246b9c req-10cabc4b-330b-457d-90f6-123c500ba195 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:30.285175 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa', 'name': 'network-vif-deleted', 'tag': '31d7a0be-14fe-4eee-8a37-db20d72be4ab'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:29:30.288023 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-52f31f91-9304-414a-9db9-49e957ad6574" -d '{"events": [{"server_uuid": "4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa", "name": "network-vif-deleted", "tag": "31d7a0be-14fe-4eee-8a37-db20d72be4ab"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:29:30.299349 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8e525c1e-a089-4071-8644-757d98246b9c req-10cabc4b-330b-457d-90f6-123c500ba195 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.63 "DELETE /v2.0/ports/31d7a0be-14fe-4eee-8a37-db20d72be4ab HTTP/1.1" status: 204  len: 173 time: 0.9739795
May 31 16:29:30.342211 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:29:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3f40921e-875c-4b5e-ad96-d1be28f6f7e8 x-openstack-request-id: req-3f40921e-875c-4b5e-ad96-d1be28f6f7e8 {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:29:30.342839 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa", "name": "network-vif-deleted", "tag": "31d7a0be-14fe-4eee-8a37-db20d72be4ab", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:29:30.342839 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-3f40921e-875c-4b5e-ad96-d1be28f6f7e8 {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:29:30.343392 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa', 'name': 'network-vif-deleted', 'tag': '31d7a0be-14fe-4eee-8a37-db20d72be4ab', 'status': 'completed', 'code': 200}
May 31 16:29:30.585571 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a8a67643-8ed0-4da6-867d-e1201a14cbc1 admin admin] Router 2bcd5afd-bdf4-472d-8a91-95997718441c has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91763) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:29:30.672401 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3fc01eb-74f0-479f-b8df-fdbdc6bb8843 req-6b2ba619-d0dc-4b9c-99bc-393808b863a9 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:30.684263 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f3fc01eb-74f0-479f-b8df-fdbdc6bb8843 req-6b2ba619-d0dc-4b9c-99bc-393808b863a9 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.1573942
May 31 16:29:30.750989 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f3fc01eb-74f0-479f-b8df-fdbdc6bb8843 req-1f112dac-58fb-4f67-93d6-78c09e7ccb00 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0632553
May 31 16:29:30.802280 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-4cf22e9b-aa9d-4fb0-931b-b3ce3a15ec37 req-d2ab54b7-511a-479a-8e39-95483e7271e9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Synchronizing usage tracker for tenant:092115f69b8e401b8c334f7b3e797aad on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:29:30.823426 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-4cf22e9b-aa9d-4fb0-931b-b3ce3a15ec37 req-d2ab54b7-511a-479a-8e39-95483e7271e9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Unset dirty status for tenant:092115f69b8e401b8c334f7b3e797aad on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:29:30.824253 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a8a67643-8ed0-4da6-867d-e1201a14cbc1 admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:29:30.824596 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4cf22e9b-aa9d-4fb0-931b-b3ce3a15ec37 req-d2ab54b7-511a-479a-8e39-95483e7271e9 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "GET /v2.0/ports?device_id=4a1e7a1d-77b3-4b90-9cdb-1b134a4a33aa HTTP/1.1" status: 200  len: 210 time: 0.0677063
May 31 16:29:30.834229 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b39fa133-37d9-48e2-a3fa-29b08bc6564e None None] Sync routers for ids ['2bcd5afd-bdf4-472d-8a91-95997718441c'] in dv-cinder-793814-1-iscsi {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:29:30.838892 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-a8a67643-8ed0-4da6-867d-e1201a14cbc1 admin admin] 10.222.0.43 "PUT /v2.0/routers/2bcd5afd-bdf4-472d-8a91-95997718441c/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.8893204
May 31 16:29:30.841445 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 38422) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:30.846420 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b39fa133-37d9-48e2-a3fa-29b08bc6564e None None] Routers {'2bcd5afd-bdf4-472d-8a91-95997718441c'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:29:30.847473 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-b39fa133-37d9-48e2-a3fa-29b08bc6564e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f14279f7820>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:29:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['2bcd5afd-bdf4-472d-8a91-95997718441c'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:31.033351 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c6e113f9-84f8-4012-8592-87cce12b1690 admin admin] Notify callbacks [] for router, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:31.037653 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-b39fa133-37d9-48e2-a3fa-29b08bc6564e None None] Set router 2bcd5afd-bdf4-472d-8a91-95997718441c gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:29:31.278105 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c6e113f9-84f8-4012-8592-87cce12b1690 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:31.289967 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c446601-ce4c-46a2-aeb7-602005815668 req-ed3c6ac0-981a-4688-8c22-59f1b59bdcc2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:31.291433 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8c446601-ce4c-46a2-aeb7-602005815668 req-ed3c6ac0-981a-4688-8c22-59f1b59bdcc2 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e&tenant_id=ff0bbba58394409987a388bb38868b4e HTTP/1.1" status: 200  len: 1099 time: 0.1202204
May 31 16:29:31.346180 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-b39fa133-37d9-48e2-a3fa-29b08bc6564e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f14279f7820>, [{'id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:24:01Z', 'updated_at': '2021-05-31T16:29:29Z', 'revision_number': 5, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'gw_port': {'id': 'e6e58ebd-df49-45cc-b013-4b6d60b76a86', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:fb:d3:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 468, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:24:02Z', 'updated_at': '2021-05-31T16:24:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:31.350638 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b39fa133-37d9-48e2-a3fa-29b08bc6564e None None] Checking router: 2bcd5afd-bdf4-472d-8a91-95997718441c for host: dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:29:31.359126 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b39fa133-37d9-48e2-a3fa-29b08bc6564e None None] Routers {'2bcd5afd-bdf4-472d-8a91-95997718441c'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:29:31.359768 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-b39fa133-37d9-48e2-a3fa-29b08bc6564e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f14279f7820>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:29:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['2bcd5afd-bdf4-472d-8a91-95997718441c'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:31.417445 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-c6e113f9-84f8-4012-8592-87cce12b1690 admin admin] Deleting port e6e58ebd-df49-45cc-b013-4b6d60b76a86 {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:29:31.418103 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c6e113f9-84f8-4012-8592-87cce12b1690 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:31.434595 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c446601-ce4c-46a2-aeb7-602005815668 req-c1188e60-d302-423e-99f7-fb070270cf15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:31.436144 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8c446601-ce4c-46a2-aeb7-602005815668 req-c1188e60-d302-423e-99f7-fb070270cf15 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=ff0bbba58394409987a388bb38868b4e&device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 1099 time: 0.1110754
May 31 16:29:31.534948 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-b39fa133-37d9-48e2-a3fa-29b08bc6564e None None] Set router 2bcd5afd-bdf4-472d-8a91-95997718441c gateway port host: None {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:29:31.644134 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-b39fa133-37d9-48e2-a3fa-29b08bc6564e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f14279f7820>, [{'id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:24:01Z', 'updated_at': '2021-05-31T16:29:31Z', 'revision_number': 6, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'gw_port_host': None}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:31.649263 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b39fa133-37d9-48e2-a3fa-29b08bc6564e None None] The sync data for ids ['2bcd5afd-bdf4-472d-8a91-95997718441c'] in dv-cinder-793814-1-iscsi is: [{'id': '2bcd5afd-bdf4-472d-8a91-95997718441c', 'name': 'tempest-AttachVolumeTestJSON-783526721-router', 'tenant_id': 'a56002dfed61485aa4d9e237932e1abf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:24:01Z', 'updated_at': '2021-05-31T16:29:31Z', 'revision_number': 6, 'project_id': 'a56002dfed61485aa4d9e237932e1abf', 'gw_port_host': None}] {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:29:31.661665 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [None req-c6e113f9-84f8-4012-8592-87cce12b1690 admin admin] For port e6e58ebd-df49-45cc-b013-4b6d60b76a86, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=e6e58ebd-df49-45cc-b013-4b6d60b76a86,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:29:31.662051 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c6e113f9-84f8-4012-8592-87cce12b1690 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:31.726906 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c446601-ce4c-46a2-aeb7-602005815668 req-82e9392e-a2f3-4bec-9016-b853a95ae347 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:31.728330 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8c446601-ce4c-46a2-aeb7-602005815668 req-82e9392e-a2f3-4bec-9016-b853a95ae347 service neutron] 10.222.0.63 "GET /v2.0/networks?id=0e202b3d-d60d-481f-bf3a-e31943668c98 HTTP/1.1" status: 200  len: 909 time: 0.2421486
May 31 16:29:31.811330 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 31d7a0be-14fe-4eee-8a37-db20d72be4ab no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:29:31.844455 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-c6e113f9-84f8-4012-8592-87cce12b1690 admin admin] Calling delete_port for e6e58ebd-df49-45cc-b013-4b6d60b76a86 owned by network:router_gateway {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:29:31.847456 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] No Port match for: 31d7a0be-14fe-4eee-8a37-db20d72be4ab {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:29:31.847918 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 31d7a0be-14fe-4eee-8a37-db20d72be4ab not bound to the agent host hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:29:31.848462 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device e42a29cb-c29c-41f8-9cfb-6379c167a596 no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:29:31.955918 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8c446601-ce4c-46a2-aeb7-602005815668 req-6be2e901-8bcb-4d73-b9b7-8c729698b283 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=e42a29cb-c29c-41f8-9cfb-6379c167a596 HTTP/1.1" status: 200  len: 1001 time: 0.1681302
May 31 16:29:31.972804 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 38432) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:32.074382 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:32.199852 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6529d1f-91df-43a3-8a15-bd131dbbfec2 req-d53a86ef-9783-4fb7-bbf2-427df5bb2176 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:32.201558 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c6529d1f-91df-43a3-8a15-bd131dbbfec2 req-d53a86ef-9783-4fb7-bbf2-427df5bb2176 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.3328259
May 31 16:29:32.202079 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd9e580af-3588-40d6-9e2a-60c321af3d1e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e42a29cb-c29c-41f8-9cfb-6379c167a596'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:29:32.203169 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c446601-ce4c-46a2-aeb7-602005815668 req-cec8eecc-91f2-4965-bb57-93b3166aec1b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:32.204612 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8c446601-ce4c-46a2-aeb7-602005815668 req-cec8eecc-91f2-4965-bb57-93b3166aec1b service neutron] 10.222.0.63 "GET /v2.0/subnets?id=20f6caad-2e13-4108-af8f-f9c2336ccde2 HTTP/1.1" status: 200  len: 847 time: 0.2402930
May 31 16:29:32.205184 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ff1de272-cbaf-47b6-899a-0234d6e4551f" -d '{"events": [{"server_uuid": "d9e580af-3588-40d6-9e2a-60c321af3d1e", "name": "network-vif-unplugged", "status": "completed", "tag": "e42a29cb-c29c-41f8-9cfb-6379c167a596"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:29:32.224324 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port e42a29cb-c29c-41f8-9cfb-6379c167a596, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=e42a29cb-c29c-41f8-9cfb-6379c167a596,segment=NetworkSegment(1e70bee6-dfc7-4037-8e59-6c6e25de8649),segment_id=1e70bee6-dfc7-4037-8e59-6c6e25de8649)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:29:32.242792 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:32.247228 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:32.297036 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Mon, 31 May 2021 16:29:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5ef837dd-fb0a-4e21-a73e-8f3a77de5217 x-openstack-request-id: req-5ef837dd-fb0a-4e21-a73e-8f3a77de5217 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:29:32.297326 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d9e580af-3588-40d6-9e2a-60c321af3d1e", "name": "network-vif-unplugged", "status": "completed", "tag": "e42a29cb-c29c-41f8-9cfb-6379c167a596", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:29:32.297437 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-5ef837dd-fb0a-4e21-a73e-8f3a77de5217 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:29:32.297871 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd9e580af-3588-40d6-9e2a-60c321af3d1e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e42a29cb-c29c-41f8-9cfb-6379c167a596', 'code': 200}
May 31 16:29:32.315024 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c6529d1f-91df-43a3-8a15-bd131dbbfec2 req-1dec792e-ffd5-44e0-ad34-4471263e0f67 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1058853
May 31 16:29:32.364605 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=e42a29cb-c29c-41f8-9cfb-6379c167a596,revision_number=6']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:32.367530 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-91209284-b9b8-4a8e-9235-5f6856769b10 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Deleting port 7ed12cbb-9226-4ddd-9d1e-f822288e8260 {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:29:32.367957 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-91209284-b9b8-4a8e-9235-5f6856769b10 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:32.374779 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:32.375128 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:32.375523 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:32.375805 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:32.376141 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:32.376472 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:32.377067 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:32.377390 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:32.377737 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:32.378064 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:32.378381 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:32.378701 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:32.383331 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:32.406470 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c446601-ce4c-46a2-aeb7-602005815668 req-9e4d3493-ee0b-40aa-93b6-f190b6b9131e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:32.408834 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8c446601-ce4c-46a2-aeb7-602005815668 req-9e4d3493-ee0b-40aa-93b6-f190b6b9131e service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=0e202b3d-d60d-481f-bf3a-e31943668c98&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1967969
May 31 16:29:32.447164 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c6e113f9-84f8-4012-8592-87cce12b1690 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:32.498474 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:32.509439 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-91209284-b9b8-4a8e-9235-5f6856769b10 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:32.509976 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-91209284-b9b8-4a8e-9235-5f6856769b10 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:32.529963 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device e6e58ebd-df49-45cc-b013-4b6d60b76a86 no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:29:32.553569 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6e113f9-84f8-4012-8592-87cce12b1690 admin admin] Pushing event deleted for resources: {'Port': ['ID=e6e58ebd-df49-45cc-b013-4b6d60b76a86,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:32.575266 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: e6e58ebd-df49-45cc-b013-4b6d60b76a86 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:29:32.575769 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device e6e58ebd-df49-45cc-b013-4b6d60b76a86 not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:29:32.576296 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 729c3966-0f99-4a7d-ab46-eadab5d24529 no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:29:32.589065 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c6e113f9-84f8-4012-8592-87cce12b1690 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:32.627770 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: 729c3966-0f99-4a7d-ab46-eadab5d24529 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:29:32.628230 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 729c3966-0f99-4a7d-ab46-eadab5d24529 not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:29:32.677852 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-91209284-b9b8-4a8e-9235-5f6856769b10 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Calling delete_port for 7ed12cbb-9226-4ddd-9d1e-f822288e8260 owned by network:floatingip {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:29:32.688181 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8c446601-ce4c-46a2-aeb7-602005815668 req-b118eb40-996b-4e1c-ab85-cc14afb3bfc7 service neutron] 10.222.0.63 "GET /v2.0/networks/0e202b3d-d60d-481f-bf3a-e31943668c98?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2698116
May 31 16:29:32.693847 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c6e113f9-84f8-4012-8592-87cce12b1690 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-16621778'] for router_gateway, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:32.805272 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-91209284-b9b8-4a8e-9235-5f6856769b10 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:32.809911 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-3ccab0d1-2364-4221-9538-fd898fa39a19 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:32.855106 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91209284-b9b8-4a8e-9235-5f6856769b10 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Pushing event deleted for resources: {'Port': ['ID=7ed12cbb-9226-4ddd-9d1e-f822288e8260,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:32.862121 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-91209284-b9b8-4a8e-9235-5f6856769b10 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:32.949510 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c6e113f9-84f8-4012-8592-87cce12b1690 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-16623711', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-683'] for router, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:32.953404 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c6e113f9-84f8-4012-8592-87cce12b1690 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:32.963988 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-91209284-b9b8-4a8e-9235-5f6856769b10 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for floatingip, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:32.983088 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-91209284-b9b8-4a8e-9235-5f6856769b10 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for floatingip, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:32.984346 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-91209284-b9b8-4a8e-9235-5f6856769b10 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "DELETE /v2.0/floatingips/3c15c76f-9cda-471e-b526-617f49a22ed5 HTTP/1.1" status: 204  len: 168 time: 1.0100152
May 31 16:29:32.994906 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c6e113f9-84f8-4012-8592-87cce12b1690 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-16623971'] for router, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:32.994906 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c6e113f9-84f8-4012-8592-87cce12b1690 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 2bcd5afd-bdf4-472d-8a91-95997718441c {{(pid=91764) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 31 16:29:33.018392 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-8c446601-ce4c-46a2-aeb7-602005815668 req-6555c097-961f-42a6-bbe1-9915f0c62648 service neutron] 10.222.0.63 "GET /v2.0/networks/0e202b3d-d60d-481f-bf3a-e31943668c98?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2755423
May 31 16:29:33.026174 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-c6e113f9-84f8-4012-8592-87cce12b1690 admin admin] Notify callbacks [] for router, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:33.027301 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-c6e113f9-84f8-4012-8592-87cce12b1690 admin admin] 10.222.0.43 "DELETE /v2.0/routers/2bcd5afd-bdf4-472d-8a91-95997718441c HTTP/1.1" status: 204  len: 168 time: 2.1846952
May 31 16:29:33.030006 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 38442) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:33.096334 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_v2 [None req-97be6f0f-5ac6-44e2-85ae-e21212cbc98d admin admin] Deleting subnet 6489943b-1236-4d7c-80a7-58ef5aedf09d {{(pid=91763) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 31 16:29:33.100071 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-97be6f0f-5ac6-44e2-85ae-e21212cbc98d admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:33.157246 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-97be6f0f-5ac6-44e2-85ae-e21212cbc98d admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-15104879'] for subnet, precommit_delete_associations {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:33.237792 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-97be6f0f-5ac6-44e2-85ae-e21212cbc98d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-975336'] for subnet, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:33.499244 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-97be6f0f-5ac6-44e2-85ae-e21212cbc98d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-978269', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14336704', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-13992643'] for subnet, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:33.504297 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:33.527624 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d874d3da-44ec-43b4-b7dd-c503158c0ba8 req-004a9e80-c2a7-462a-bef1-ace5bb618e15 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:33.529153 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d874d3da-44ec-43b4-b7dd-c503158c0ba8 req-004a9e80-c2a7-462a-bef1-ace5bb618e15 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 944 time: 0.0905488
May 31 16:29:33.541849 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97be6f0f-5ac6-44e2-85ae-e21212cbc98d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6489943b-1236-4d7c-80a7-58ef5aedf09d,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:33.543651 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-97be6f0f-5ac6-44e2-85ae-e21212cbc98d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:33.546308 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-97be6f0f-5ac6-44e2-85ae-e21212cbc98d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:33.550691 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-97be6f0f-5ac6-44e2-85ae-e21212cbc98d admin admin] 10.222.0.43 "DELETE /v2.0/subnets/6489943b-1236-4d7c-80a7-58ef5aedf09d HTTP/1.1" status: 204  len: 168 time: 0.5195582
May 31 16:29:33.553642 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 38454) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:33.555003 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0231d247-7432-477f-95e8-83470dea920b None None] Network cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:29:33.657681 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d874d3da-44ec-43b4-b7dd-c503158c0ba8 req-dbc14963-db01-4551-8e36-1894d92c8b37 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1225944
May 31 16:29:33.678553 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-525980'] for network, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:33.759649 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] Deleting port 3509d824-80ea-4504-9f8f-a0c27f442aeb {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:29:33.760060 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:33.820910 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc773a2e-9b01-40e8-8979-05659f042224 None None] DHCP port deletion for cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 request from dv-cinder-793814-1-iscsi {{(pid=91765) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 31 16:29:33.863158 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] For port 3509d824-80ea-4504-9f8f-a0c27f442aeb, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=3509d824-80ea-4504-9f8f-a0c27f442aeb,segment=NetworkSegment(1974822a-78ff-4607-935a-c9f5ba4a898d),segment_id=1974822a-78ff-4607-935a-c9f5ba4a898d)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:29:33.863765 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:33.903353 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-cc773a2e-9b01-40e8-8979-05659f042224 None None] Deleting port 3509d824-80ea-4504-9f8f-a0c27f442aeb {{(pid=91765) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:29:33.903867 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-cc773a2e-9b01-40e8-8979-05659f042224 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:33.986980 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] Calling delete_port for 3509d824-80ea-4504-9f8f-a0c27f442aeb owned by network:dhcp {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:29:34.039073 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:34.043771 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c4ba19ac-0ca5-4185-8cd4-04a6447df7a7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:34.047269 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-cc773a2e-9b01-40e8-8979-05659f042224 None None] For port 3509d824-80ea-4504-9f8f-a0c27f442aeb, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=3509d824-80ea-4504-9f8f-a0c27f442aeb,segment=NetworkSegment(1974822a-78ff-4607-935a-c9f5ba4a898d),segment_id=1974822a-78ff-4607-935a-c9f5ba4a898d)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:29:34.047745 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-cc773a2e-9b01-40e8-8979-05659f042224 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:34.169220 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-cc773a2e-9b01-40e8-8979-05659f042224 None None] Calling delete_port for 3509d824-80ea-4504-9f8f-a0c27f442aeb owned by network:dhcp {{(pid=91765) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:29:34.204545 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] Pushing event deleted for resources: {'Port': ['ID=3509d824-80ea-4504-9f8f-a0c27f442aeb,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:34.206696 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] No DVR routers for this DVR port 3509d824-80ea-4504-9f8f-a0c27f442aeb on host dv-cinder-793814-1-iscsi {{(pid=91764) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:29:34.209725 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:34.217118 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-cc773a2e-9b01-40e8-8979-05659f042224 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907'] for port, after_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:34.221016 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:34.267620 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc773a2e-9b01-40e8-8979-05659f042224 None None] Pushing event deleted for resources: {'Port': ['ID=3509d824-80ea-4504-9f8f-a0c27f442aeb,revision_number=None']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:34.271361 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-cc773a2e-9b01-40e8-8979-05659f042224 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:34.272062 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc773a2e-9b01-40e8-8979-05659f042224 None None] No DVR routers for this DVR port 3509d824-80ea-4504-9f8f-a0c27f442aeb on host dv-cinder-793814-1-iscsi {{(pid=91765) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:29:34.331031 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-988775', 'neutron.services.segments.db._delete_segments_for_network-8732784586204'] for network, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:34.345852 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f14252d2a90>,) {'filters': {'network_id': ['cd1ac218-ff8f-46e5-91e3-f1ff613f07d5']}} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:34.360310 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f14252d2a90>, '1974822a-78ff-4607-935a-c9f5ba4a898d') {'for_net_delete': True} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:34.360710 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f14252d2a90>, '1974822a-78ff-4607-935a-c9f5ba4a898d') {} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:34.372368 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732784599197', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14907379'] for segment, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:34.389390 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:34.401237 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 38470) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:34.405809 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] Releasing vlan 833 on physical network physnet1 to pool {{(pid=91764) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 31 16:29:34.407102 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14905732'] for segment, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]: Traceback (most recent call last):
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:     timer()
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:     cb(*args, **kw)
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:     return func(*args, **kwargs)
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:     self._notify()
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:     self.callback(batched_events)
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:     event.method(event)
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:     aggregate_uuid = self.p_client.list_aggregates(
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:     return f(self, *a, **k)
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self._get(url).json()
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self.request(url, 'GET', **kwargs)
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:     base_url = self.get_endpoint(auth, allow=allow,
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 31 16:29:34.421847 dv-cinder-793814-1-iscsi neutron-server[91764]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 31 16:29:34.454847 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 3509d824-80ea-4504-9f8f-a0c27f442aeb no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:29:34.489101 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1c35ce22-7333-413f-874e-ff21d4817e6f tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:34.497796 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: 3509d824-80ea-4504-9f8f-a0c27f442aeb {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:29:34.498278 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 3509d824-80ea-4504-9f8f-a0c27f442aeb not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:29:34.522687 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16621775'] for network, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:34.524560 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1c35ce22-7333-413f-874e-ff21d4817e6f tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:34.527125 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-c91ea264-e461-4320-b7f4-8e7c72577d28 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:34.546506 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:34.557776 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] Pushing event deleted for resources: {'Network': ['ID=cd1ac218-ff8f-46e5-91e3-f1ff613f07d5,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:34.573004 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:34.576889 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] 10.222.0.43 "DELETE /v2.0/networks/cd1ac218-ff8f-46e5-91e3-f1ff613f07d5 HTTP/1.1" status: 204  len: 168 time: 1.0222485
May 31 16:29:34.604082 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1c35ce22-7333-413f-874e-ff21d4817e6f tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:34.607999 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-68fb9959-498a-4c80-a3c9-25ec3db6738d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:34.623796 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c35ce22-7333-413f-874e-ff21d4817e6f tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b16a6ce7-d949-48d8-8c08-03576b09b2e8,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:34.626305 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-1c35ce22-7333-413f-874e-ff21d4817e6f tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:34.637969 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-1c35ce22-7333-413f-874e-ff21d4817e6f tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:34.641812 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-1c35ce22-7333-413f-874e-ff21d4817e6f tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] 10.222.0.43 "DELETE /v2.0/security-groups/b16a6ce7-d949-48d8-8c08-03576b09b2e8 HTTP/1.1" status: 204  len: 168 time: 0.2368579
May 31 16:29:34.695701 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 38484) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:34.711052 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 38490) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:34.765913 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-35ecad28-b69b-4ec2-acba-1e971e707f68 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=a56002dfed61485aa4d9e237932e1abf&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0505481
May 31 16:29:34.766118 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 38494) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:34.837749 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-55e8ea09-4609-489f-83dd-400b30fd3517 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:34.867310 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19076b3a-b4f6-4701-939a-6eeb9cc1084e req-90b69b18-e651-42eb-9e05-3af0a72f29c3 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:34.868815 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-19076b3a-b4f6-4701-939a-6eeb9cc1084e req-90b69b18-e651-42eb-9e05-3af0a72f29c3 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 944 time: 0.0938170
May 31 16:29:34.871523 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-55e8ea09-4609-489f-83dd-400b30fd3517 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:34.931908 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-55e8ea09-4609-489f-83dd-400b30fd3517 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:34.935729 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-1b2136a3-cb95-4749-9451-71eaae6c7edd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:34.948892 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55e8ea09-4609-489f-83dd-400b30fd3517 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=82558f49-83e7-4f32-9c14-4463c79b2f03,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:34.958424 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-55e8ea09-4609-489f-83dd-400b30fd3517 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:34.964165 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-55e8ea09-4609-489f-83dd-400b30fd3517 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:34.975708 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-55e8ea09-4609-489f-83dd-400b30fd3517 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/82558f49-83e7-4f32-9c14-4463c79b2f03 HTTP/1.1" status: 204  len: 168 time: 0.2010729
May 31 16:29:34.996453 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-19076b3a-b4f6-4701-939a-6eeb9cc1084e req-61507dac-b584-46ae-93ac-6fbd16d64723 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1216304
May 31 16:29:35.029355 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-4daa5624-34ed-4cac-8e32-eda9b36bdf6b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:35.477779 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-75ccc6d2-b1dd-468b-9fba-ad8602bbc1b2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-16627919'] for router_interface, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:35.901348 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-75ccc6d2-b1dd-468b-9fba-ad8602bbc1b2 admin admin] Deleting port 27a83f61-e253-4ba1-954c-e810e9a33917 {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:29:35.902048 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-75ccc6d2-b1dd-468b-9fba-ad8602bbc1b2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:36.196558 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [None req-75ccc6d2-b1dd-468b-9fba-ad8602bbc1b2 admin admin] For port 27a83f61-e253-4ba1-954c-e810e9a33917, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=27a83f61-e253-4ba1-954c-e810e9a33917,segment=NetworkSegment(fb1fd409-498f-4f29-82bc-1d244a7a3ed1),segment_id=fb1fd409-498f-4f29-82bc-1d244a7a3ed1)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:29:36.196979 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-75ccc6d2-b1dd-468b-9fba-ad8602bbc1b2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:36.334967 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-75ccc6d2-b1dd-468b-9fba-ad8602bbc1b2 admin admin] Calling delete_port for 27a83f61-e253-4ba1-954c-e810e9a33917 owned by network:router_interface {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:29:36.369716 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11ffc749-8045-4ebb-a0d6-0efa6e8995b0 req-e53fd3e1-c2ec-4726-8363-a26df8dbf770 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:36.371221 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-11ffc749-8045-4ebb-a0d6-0efa6e8995b0 req-e53fd3e1-c2ec-4726-8363-a26df8dbf770 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 944 time: 0.2527900
May 31 16:29:36.434315 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-11ffc749-8045-4ebb-a0d6-0efa6e8995b0 req-51c0ecd4-0a19-48e3-ab2e-9424fef062eb tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0569057
May 31 16:29:36.543057 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-75ccc6d2-b1dd-468b-9fba-ad8602bbc1b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:36.547578 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:36.601335 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75ccc6d2-b1dd-468b-9fba-ad8602bbc1b2 admin admin] Pushing event deleted for resources: {'Port': ['ID=27a83f61-e253-4ba1-954c-e810e9a33917,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:36.604117 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-75ccc6d2-b1dd-468b-9fba-ad8602bbc1b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:36.873014 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-75ccc6d2-b1dd-468b-9fba-ad8602bbc1b2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-16317375', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-16625247'] for router_interface, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:37.232324 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-75ccc6d2-b1dd-468b-9fba-ad8602bbc1b2 admin admin] Router 80126872-1960-4f13-9ca2-0eaf66181e32 has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91764) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:29:37.409448 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-75ccc6d2-b1dd-468b-9fba-ad8602bbc1b2 admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91764) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:29:37.419759 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06c663fa-14be-4345-bb30-ce8b3bae2336 None None] Sync routers for ids ['80126872-1960-4f13-9ca2-0eaf66181e32'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:29:37.425854 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-75ccc6d2-b1dd-468b-9fba-ad8602bbc1b2 admin admin] 10.222.0.43 "PUT /v2.0/routers/80126872-1960-4f13-9ca2-0eaf66181e32/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7264333
May 31 16:29:37.426054 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 38544) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:37.432748 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06c663fa-14be-4345-bb30-ce8b3bae2336 None None] Routers {'80126872-1960-4f13-9ca2-0eaf66181e32'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:29:37.433445 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-06c663fa-14be-4345-bb30-ce8b3bae2336 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1427070f10>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:29:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['80126872-1960-4f13-9ca2-0eaf66181e32'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:37.622212 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-06c663fa-14be-4345-bb30-ce8b3bae2336 None None] Set router 80126872-1960-4f13-9ca2-0eaf66181e32 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:29:37.632847 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-53571162-f2af-45db-a039-e9ff2a70035f admin admin] Notify callbacks [] for router, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:37.769240 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcd29884-b648-4046-817e-55c20af38bce req-7eee85ee-e620-4f01-b47b-e61eded83c28 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:37.772320 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-dcd29884-b648-4046-817e-55c20af38bce req-7eee85ee-e620-4f01-b47b-e61eded83c28 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 944 time: 0.2226028
May 31 16:29:37.831807 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-dcd29884-b648-4046-817e-55c20af38bce req-0b54760c-eae9-402e-bbf3-f878f20ba712 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0529876
May 31 16:29:37.946780 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-53571162-f2af-45db-a039-e9ff2a70035f admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:37.957001 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:38.006783 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-06c663fa-14be-4345-bb30-ce8b3bae2336 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1427070f10>, [{'id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229'}], 'enable_snat': True}, 'gw_port_id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:05Z', 'updated_at': '2021-05-31T16:29:36Z', 'revision_number': 5, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'gw_port': {'id': '6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:7b:b8:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.229', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:06Z', 'updated_at': '2021-05-31T16:21:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:38.011385 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06c663fa-14be-4345-bb30-ce8b3bae2336 None None] Checking router: 80126872-1960-4f13-9ca2-0eaf66181e32 for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:29:38.024262 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06c663fa-14be-4345-bb30-ce8b3bae2336 None None] Routers {'80126872-1960-4f13-9ca2-0eaf66181e32'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:29:38.025095 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-06c663fa-14be-4345-bb30-ce8b3bae2336 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1427070f10>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:29:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['80126872-1960-4f13-9ca2-0eaf66181e32'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:38.033703 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-53571162-f2af-45db-a039-e9ff2a70035f admin admin] Deleting port 6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4 {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:29:38.034177 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-53571162-f2af-45db-a039-e9ff2a70035f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:38.159163 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [None req-53571162-f2af-45db-a039-e9ff2a70035f admin admin] For port 6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:29:38.159544 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-53571162-f2af-45db-a039-e9ff2a70035f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:38.191497 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-06c663fa-14be-4345-bb30-ce8b3bae2336 None None] Set router 80126872-1960-4f13-9ca2-0eaf66181e32 gateway port host: None {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:29:38.287262 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-53571162-f2af-45db-a039-e9ff2a70035f admin admin] Calling delete_port for 6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4 owned by network:router_gateway {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:29:38.304603 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-06c663fa-14be-4345-bb30-ce8b3bae2336 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1427070f10>, [{'id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:05Z', 'updated_at': '2021-05-31T16:29:37Z', 'revision_number': 6, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'gw_port_host': None}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:38.310893 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06c663fa-14be-4345-bb30-ce8b3bae2336 None None] The sync data for ids ['80126872-1960-4f13-9ca2-0eaf66181e32'] in dv-cinder-793814-1-iscsi is: [{'id': '80126872-1960-4f13-9ca2-0eaf66181e32', 'name': 'tempest-TestVolumeBootPattern-1861877954-router', 'tenant_id': '092115f69b8e401b8c334f7b3e797aad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:05Z', 'updated_at': '2021-05-31T16:29:37Z', 'revision_number': 6, 'project_id': '092115f69b8e401b8c334f7b3e797aad', 'gw_port_host': None}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:29:38.314819 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-4130e032-cb7f-41b3-bb58-46d53e30e068 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:38.428435 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-53571162-f2af-45db-a039-e9ff2a70035f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:38.432919 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:38.479647 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53571162-f2af-45db-a039-e9ff2a70035f admin admin] Pushing event deleted for resources: {'Port': ['ID=6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:38.505858 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-53571162-f2af-45db-a039-e9ff2a70035f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:38.568035 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-53571162-f2af-45db-a039-e9ff2a70035f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-16621778'] for router_gateway, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:38.747533 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-53571162-f2af-45db-a039-e9ff2a70035f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-16623711', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-683'] for router, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:38.749920 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-53571162-f2af-45db-a039-e9ff2a70035f admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:38.773045 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-53571162-f2af-45db-a039-e9ff2a70035f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-16623971'] for router, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:38.773654 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-53571162-f2af-45db-a039-e9ff2a70035f admin admin] Fanout notify agent at l3_agent the message router_deleted on router 80126872-1960-4f13-9ca2-0eaf66181e32 {{(pid=91763) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 31 16:29:38.785672 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-53571162-f2af-45db-a039-e9ff2a70035f admin admin] Notify callbacks [] for router, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:38.787305 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-53571162-f2af-45db-a039-e9ff2a70035f admin admin] 10.222.0.43 "DELETE /v2.0/routers/80126872-1960-4f13-9ca2-0eaf66181e32 HTTP/1.1" status: 204  len: 168 time: 1.3604991
May 31 16:29:38.790215 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 38568) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:38.849222 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_v2 [None req-3fc609ba-ae57-4119-b9d6-ca19a2851f3b admin admin] Deleting subnet 995d9a2e-7e88-458e-9385-d135c0e07276 {{(pid=91764) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 31 16:29:38.852375 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3fc609ba-ae57-4119-b9d6-ca19a2851f3b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:38.904107 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3fc609ba-ae57-4119-b9d6-ca19a2851f3b admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14907384'] for subnet, precommit_delete_associations {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:39.046201 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3fc609ba-ae57-4119-b9d6-ca19a2851f3b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-975336'] for subnet, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:39.087388 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ba9bd88-221a-4302-a70b-5eb21fc02fd5 req-066311cc-448e-4407-b022-a8f803a8857e tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:39.088911 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4ba9bd88-221a-4302-a70b-5eb21fc02fd5 req-066311cc-448e-4407-b022-a8f803a8857e tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 944 time: 0.1439140
May 31 16:29:39.102838 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 27a83f61-e253-4ba1-954c-e810e9a33917 no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:29:39.142056 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: 27a83f61-e253-4ba1-954c-e810e9a33917 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:29:39.142498 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 27a83f61-e253-4ba1-954c-e810e9a33917 not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:29:39.181656 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:39.219672 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4ba9bd88-221a-4302-a70b-5eb21fc02fd5 req-99da3af9-d525-45f0-ae74-9e2a47d2f0c7 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1239471
May 31 16:29:39.365098 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3fc609ba-ae57-4119-b9d6-ca19a2851f3b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-978269', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14907170', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14793691'] for subnet, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:39.370187 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-5ac23c4f-7dbb-429d-9d8a-26b429c8a0ae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:39.406375 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3fc609ba-ae57-4119-b9d6-ca19a2851f3b admin admin] Notify callbacks [] for subnet, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:39.411245 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a22be63-014c-42b9-b625-e7c0d58235e5 None None] Network 5b237728-dc31-4203-bbac-66ce3db1593a requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:29:39.413770 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fc609ba-ae57-4119-b9d6-ca19a2851f3b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=995d9a2e-7e88-458e-9385-d135c0e07276,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:39.416023 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-3fc609ba-ae57-4119-b9d6-ca19a2851f3b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:39.418958 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-3fc609ba-ae57-4119-b9d6-ca19a2851f3b admin admin] 10.222.0.43 "DELETE /v2.0/subnets/995d9a2e-7e88-458e-9385-d135c0e07276 HTTP/1.1" status: 204  len: 168 time: 0.6277039
May 31 16:29:39.421389 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 38580) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:39.527440 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-525980'] for network, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:39.601697 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] Deleting port 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1 {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:29:39.602044 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:39.692260 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f3da7c82-1707-4654-9d5b-b49c100ea979 None None] DHCP port deletion for 5b237728-dc31-4203-bbac-66ce3db1593a request from dv-cinder-793814-1-iscsi {{(pid=91765) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 31 16:29:39.704503 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] For port 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=5b8fe218-6e1c-4c2b-9624-2e573c7d41d1,segment=NetworkSegment(fb1fd409-498f-4f29-82bc-1d244a7a3ed1),segment_id=fb1fd409-498f-4f29-82bc-1d244a7a3ed1)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:29:39.704881 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:39.756995 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-f3da7c82-1707-4654-9d5b-b49c100ea979 None None] Deleting port 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1 {{(pid=91765) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:29:39.757375 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f3da7c82-1707-4654-9d5b-b49c100ea979 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:39.827236 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] Calling delete_port for 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1 owned by network:dhcp {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:29:39.857661 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-f3da7c82-1707-4654-9d5b-b49c100ea979 None None] For port 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=5b8fe218-6e1c-4c2b-9624-2e573c7d41d1,segment=NetworkSegment(fb1fd409-498f-4f29-82bc-1d244a7a3ed1),segment_id=fb1fd409-498f-4f29-82bc-1d244a7a3ed1)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:29:39.858067 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f3da7c82-1707-4654-9d5b-b49c100ea979 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:39.874376 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:39.878356 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-9cfbed91-35fc-408f-a034-76d63dc0d6ad service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:39.925114 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] Pushing event deleted for resources: {'Port': ['ID=5b8fe218-6e1c-4c2b-9624-2e573c7d41d1,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:39.928665 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:39.929440 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] No DVR routers for this DVR port 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1 on host dv-cinder-793814-1-iscsi {{(pid=91764) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:29:39.985671 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-f3da7c82-1707-4654-9d5b-b49c100ea979 None None] Calling delete_port for 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1 owned by network:dhcp {{(pid=91765) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:29:40.029810 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f3da7c82-1707-4654-9d5b-b49c100ea979 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907'] for port, after_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:40.033317 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:40.048828 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-988775', 'neutron.services.segments.db._delete_segments_for_network-8732784586204'] for network, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:40.063362 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f1426562b50>,) {'filters': {'network_id': ['5b237728-dc31-4203-bbac-66ce3db1593a']}} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:40.075537 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f1426562b50>, 'fb1fd409-498f-4f29-82bc-1d244a7a3ed1') {'for_net_delete': True} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:40.075839 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f1426562b50>, 'fb1fd409-498f-4f29-82bc-1d244a7a3ed1') {} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:40.076468 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3da7c82-1707-4654-9d5b-b49c100ea979 None None] Pushing event deleted for resources: {'Port': ['ID=5b8fe218-6e1c-4c2b-9624-2e573c7d41d1,revision_number=None']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:40.080122 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-f3da7c82-1707-4654-9d5b-b49c100ea979 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:40.082332 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3da7c82-1707-4654-9d5b-b49c100ea979 None None] No DVR routers for this DVR port 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1 on host dv-cinder-793814-1-iscsi {{(pid=91765) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:29:40.092175 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732784599197', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14907379'] for segment, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:40.109925 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:40.118472 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] Releasing vlan 805 on physical network physnet1 to pool {{(pid=91764) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 31 16:29:40.118986 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14905732'] for segment, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]: Traceback (most recent call last):
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:     timer()
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:     cb(*args, **kw)
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:     return func(*args, **kwargs)
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:     self._notify()
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:     self.callback(batched_events)
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:     event.method(event)
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:     aggregate_uuid = self.p_client.list_aggregates(
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:     return f(self, *a, **k)
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self._get(url).json()
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self.request(url, 'GET', **kwargs)
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:     base_url = self.get_endpoint(auth, allow=allow,
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 31 16:29:40.133108 dv-cinder-793814-1-iscsi neutron-server[91764]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 31 16:29:40.211830 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16621775'] for network, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:40.215423 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-ca8ab3ea-ae55-4668-acb3-5463ba3a7a21 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:40.228256 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:40.240118 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] Pushing event deleted for resources: {'Network': ['ID=5b237728-dc31-4203-bbac-66ce3db1593a,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:40.244150 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:40.253456 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-bfc4c666-e868-4664-8e96-57eecbac8ac3 admin admin] 10.222.0.43 "DELETE /v2.0/networks/5b237728-dc31-4203-bbac-66ce3db1593a HTTP/1.1" status: 204  len: 168 time: 0.8308628
May 31 16:29:40.263243 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 38590) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:40.447092 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4 no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:29:40.481839 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: 6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:29:40.482106 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 6b3b8059-6750-40e0-92ba-9c9e7d4bbaf4 not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:29:40.482526 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1 no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:29:40.514566 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:29:40.514922 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 5b8fe218-6e1c-4c2b-9624-2e573c7d41d1 not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:29:40.685344 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa34adc1-27db-4782-92cf-0260387f2324 req-5b235b83-9d49-4ba1-9b41-3e0b6904a170 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:40.686823 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-fa34adc1-27db-4782-92cf-0260387f2324 req-5b235b83-9d49-4ba1-9b41-3e0b6904a170 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 944 time: 0.3561540
May 31 16:29:40.818058 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-fa34adc1-27db-4782-92cf-0260387f2324 req-c5561e0b-31f2-49b9-94d6-b7bb6121456c tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1223965
May 31 16:29:40.889689 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:41.042380 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e1ae2709-9a54-4688-a36c-f0cc14108b6f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-16627919'] for router_interface, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:41.459810 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-e1ae2709-9a54-4688-a36c-f0cc14108b6f admin admin] Deleting port 321d16c6-0236-4519-8174-ad604590b1fc {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:29:41.460245 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e1ae2709-9a54-4688-a36c-f0cc14108b6f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:41.583020 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [None req-e1ae2709-9a54-4688-a36c-f0cc14108b6f admin admin] For port 321d16c6-0236-4519-8174-ad604590b1fc, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=321d16c6-0236-4519-8174-ad604590b1fc,segment=NetworkSegment(82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996),segment_id=82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:29:41.583392 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e1ae2709-9a54-4688-a36c-f0cc14108b6f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:41.708790 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-e1ae2709-9a54-4688-a36c-f0cc14108b6f admin admin] Calling delete_port for 321d16c6-0236-4519-8174-ad604590b1fc owned by network:router_interface {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:29:41.916363 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2742753-313a-4d49-8fa3-7efc0b634802 req-16a5db2e-bb1b-4687-8c4f-1af5886a6e76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:41.917905 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a2742753-313a-4d49-8fa3-7efc0b634802 req-16a5db2e-bb1b-4687-8c4f-1af5886a6e76 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 1097 time: 0.1352615
May 31 16:29:41.949313 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e1ae2709-9a54-4688-a36c-f0cc14108b6f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:42.092436 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-403c9ae4-42e9-47fe-825c-7c709d6bfcf4 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:42.196182 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1ae2709-9a54-4688-a36c-f0cc14108b6f admin admin] Pushing event deleted for resources: {'Port': ['ID=321d16c6-0236-4519-8174-ad604590b1fc,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:42.200677 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-e1ae2709-9a54-4688-a36c-f0cc14108b6f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:42.212431 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a2742753-313a-4d49-8fa3-7efc0b634802 req-fd0ad3ab-bba1-4438-8af8-4d76f20ff709 service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2872164
May 31 16:29:42.369843 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54998f16-35ab-4126-9d77-4273275db853 req-2c593fa3-9f71-4376-84bb-7e9cb2d3de0c tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:42.371690 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-54998f16-35ab-4126-9d77-4273275db853 req-2c593fa3-9f71-4376-84bb-7e9cb2d3de0c tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 944 time: 0.4265578
May 31 16:29:42.509380 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-54998f16-35ab-4126-9d77-4273275db853 req-2d2b1b5a-4741-4128-a14a-42d4ce372f91 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1276252
May 31 16:29:42.529638 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e1ae2709-9a54-4688-a36c-f0cc14108b6f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-16317375', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-16625247'] for router_interface, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:42.934803 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e1ae2709-9a54-4688-a36c-f0cc14108b6f admin admin] Router bdad89a7-282d-4ae9-8124-6eabc155bcbe has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91764) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:29:43.125018 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e1ae2709-9a54-4688-a36c-f0cc14108b6f admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91764) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:29:43.136064 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-e1ae2709-9a54-4688-a36c-f0cc14108b6f admin admin] 10.222.0.43 "PUT /v2.0/routers/bdad89a7-282d-4ae9-8124-6eabc155bcbe/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.8716836
May 31 16:29:43.138368 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 38624) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:43.142051 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60ae6015-7c5c-412b-b7ae-d2c4f4e6cb94 None None] Sync routers for ids ['bdad89a7-282d-4ae9-8124-6eabc155bcbe'] in dv-cinder-793814-1-iscsi {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:29:43.160235 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60ae6015-7c5c-412b-b7ae-d2c4f4e6cb94 None None] Routers {'bdad89a7-282d-4ae9-8124-6eabc155bcbe'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:29:43.162717 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-60ae6015-7c5c-412b-b7ae-d2c4f4e6cb94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426dc6130>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:29:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['bdad89a7-282d-4ae9-8124-6eabc155bcbe'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:43.317413 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-601eb322-01d7-4d42-9d70-51cc9cf93bda admin admin] Notify callbacks [] for router, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:43.353664 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-60ae6015-7c5c-412b-b7ae-d2c4f4e6cb94 None None] Set router bdad89a7-282d-4ae9-8124-6eabc155bcbe gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:29:43.620600 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-601eb322-01d7-4d42-9d70-51cc9cf93bda admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:43.648944 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-60ae6015-7c5c-412b-b7ae-d2c4f4e6cb94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426dc6130>, [{'id': 'bdad89a7-282d-4ae9-8124-6eabc155bcbe', 'name': 'tempest-TestVolumeBootPattern-9966473-router', 'tenant_id': 'd632158d834f4af7851eaec17fb0b06f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.177'}], 'enable_snat': True}, 'gw_port_id': '5f8286e6-a0de-4023-a9eb-6eeb4f27b09f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:14Z', 'updated_at': '2021-05-31T16:29:41Z', 'revision_number': 5, 'project_id': 'd632158d834f4af7851eaec17fb0b06f', 'gw_port': {'id': '5f8286e6-a0de-4023-a9eb-6eeb4f27b09f', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:f0:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bdad89a7-282d-4ae9-8124-6eabc155bcbe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 281, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:21:16Z', 'updated_at': '2021-05-31T16:21:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:43.652839 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60ae6015-7c5c-412b-b7ae-d2c4f4e6cb94 None None] Checking router: bdad89a7-282d-4ae9-8124-6eabc155bcbe for host: dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:29:43.661624 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60ae6015-7c5c-412b-b7ae-d2c4f4e6cb94 None None] Routers {'bdad89a7-282d-4ae9-8124-6eabc155bcbe'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:29:43.662464 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-60ae6015-7c5c-412b-b7ae-d2c4f4e6cb94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426dc6130>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:29:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['bdad89a7-282d-4ae9-8124-6eabc155bcbe'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:43.773907 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-601eb322-01d7-4d42-9d70-51cc9cf93bda admin admin] Deleting port 5f8286e6-a0de-4023-a9eb-6eeb4f27b09f {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:29:43.774323 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-601eb322-01d7-4d42-9d70-51cc9cf93bda admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:43.796543 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-133cd527-6cf3-47b1-ac7e-36ee787d224a req-17ea35bd-e08c-41f2-bb9a-d3c53018eb5b tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:29:43.798029 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-133cd527-6cf3-47b1-ac7e-36ee787d224a req-17ea35bd-e08c-41f2-bb9a-d3c53018eb5b tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 944 time: 0.1274061
May 31 16:29:43.819996 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-60ae6015-7c5c-412b-b7ae-d2c4f4e6cb94 None None] Set router bdad89a7-282d-4ae9-8124-6eabc155bcbe gateway port host: None {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:29:43.918676 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-133cd527-6cf3-47b1-ac7e-36ee787d224a req-8b378f12-0a47-4fc0-8d2d-934f723f709f tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1142228
May 31 16:29:43.925065 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-60ae6015-7c5c-412b-b7ae-d2c4f4e6cb94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426dc6130>, [{'id': 'bdad89a7-282d-4ae9-8124-6eabc155bcbe', 'name': 'tempest-TestVolumeBootPattern-9966473-router', 'tenant_id': 'd632158d834f4af7851eaec17fb0b06f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:14Z', 'updated_at': '2021-05-31T16:29:43Z', 'revision_number': 6, 'project_id': 'd632158d834f4af7851eaec17fb0b06f', 'gw_port_host': None}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:43.929964 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60ae6015-7c5c-412b-b7ae-d2c4f4e6cb94 None None] The sync data for ids ['bdad89a7-282d-4ae9-8124-6eabc155bcbe'] in dv-cinder-793814-1-iscsi is: [{'id': 'bdad89a7-282d-4ae9-8124-6eabc155bcbe', 'name': 'tempest-TestVolumeBootPattern-9966473-router', 'tenant_id': 'd632158d834f4af7851eaec17fb0b06f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:21:14Z', 'updated_at': '2021-05-31T16:29:43Z', 'revision_number': 6, 'project_id': 'd632158d834f4af7851eaec17fb0b06f', 'gw_port_host': None}] {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:29:43.949473 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [None req-601eb322-01d7-4d42-9d70-51cc9cf93bda admin admin] For port 5f8286e6-a0de-4023-a9eb-6eeb4f27b09f, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=5f8286e6-a0de-4023-a9eb-6eeb4f27b09f,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:29:43.949891 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-601eb322-01d7-4d42-9d70-51cc9cf93bda admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:44.076357 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-601eb322-01d7-4d42-9d70-51cc9cf93bda admin admin] Calling delete_port for 5f8286e6-a0de-4023-a9eb-6eeb4f27b09f owned by network:router_gateway {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:29:44.216687 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-601eb322-01d7-4d42-9d70-51cc9cf93bda admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:44.221425 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-b6fd3b33-7cef-4bba-82c4-e6b320ce5d09 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:44.265914 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-601eb322-01d7-4d42-9d70-51cc9cf93bda admin admin] Pushing event deleted for resources: {'Port': ['ID=5f8286e6-a0de-4023-a9eb-6eeb4f27b09f,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:44.268398 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-601eb322-01d7-4d42-9d70-51cc9cf93bda admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:44.366866 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-601eb322-01d7-4d42-9d70-51cc9cf93bda admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-16621778'] for router_gateway, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:44.511982 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device e42a29cb-c29c-41f8-9cfb-6379c167a596 details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:29:44.542767 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-601eb322-01d7-4d42-9d70-51cc9cf93bda admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-16623711', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-683'] for router, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:44.545449 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-601eb322-01d7-4d42-9d70-51cc9cf93bda admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:44.571945 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-601eb322-01d7-4d42-9d70-51cc9cf93bda admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-16623971'] for router, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:44.572457 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-601eb322-01d7-4d42-9d70-51cc9cf93bda admin admin] Fanout notify agent at l3_agent the message router_deleted on router bdad89a7-282d-4ae9-8124-6eabc155bcbe {{(pid=91764) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 31 16:29:44.587217 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-601eb322-01d7-4d42-9d70-51cc9cf93bda admin admin] Notify callbacks [] for router, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:44.588335 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-601eb322-01d7-4d42-9d70-51cc9cf93bda admin admin] 10.222.0.43 "DELETE /v2.0/routers/bdad89a7-282d-4ae9-8124-6eabc155bcbe HTTP/1.1" status: 204  len: 168 time: 1.4490085
May 31 16:29:44.591031 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 38646) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:44.648720 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port e42a29cb-c29c-41f8-9cfb-6379c167a596, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=e42a29cb-c29c-41f8-9cfb-6379c167a596,segment=NetworkSegment(1e70bee6-dfc7-4037-8e59-6c6e25de8649),segment_id=1e70bee6-dfc7-4037-8e59-6c6e25de8649)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:29:44.650363 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_v2 [None req-eaa83d17-ec15-4eda-bb28-3b81e5a4a181 admin admin] Deleting subnet fbc4ea0f-be4f-4d1c-a5f9-9c05726a34ab {{(pid=91764) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 31 16:29:44.653345 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-eaa83d17-ec15-4eda-bb28-3b81e5a4a181 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:44.666707 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': 'e42a29cb-c29c-41f8-9cfb-6379c167a596', 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98', 'port_id': 'e42a29cb-c29c-41f8-9cfb-6379c167a596', 'mac_address': 'fa:16:3e:0a:33:5d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 823, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '20f6caad-2e13-4108-af8f-f9c2336ccde2', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:29:44.719033 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-eaa83d17-ec15-4eda-bb28-3b81e5a4a181 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14907384'] for subnet, precommit_delete_associations {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:44.729365 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:44.744957 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 5f8286e6-a0de-4023-a9eb-6eeb4f27b09f no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:29:44.784795 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e42a29cb-c29c-41f8-9cfb-6379c167a596 {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:29:44.788862 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: 5f8286e6-a0de-4023-a9eb-6eeb4f27b09f {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:29:44.789213 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 5f8286e6-a0de-4023-a9eb-6eeb4f27b09f not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:29:44.789878 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 321d16c6-0236-4519-8174-ad604590b1fc no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:29:44.804416 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-eaa83d17-ec15-4eda-bb28-3b81e5a4a181 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-975336'] for subnet, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:44.834639 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: 321d16c6-0236-4519-8174-ad604590b1fc {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:29:44.834996 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 321d16c6-0236-4519-8174-ad604590b1fc not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:29:44.842185 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port e42a29cb-c29c-41f8-9cfb-6379c167a596, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=e42a29cb-c29c-41f8-9cfb-6379c167a596,segment=NetworkSegment(1e70bee6-dfc7-4037-8e59-6c6e25de8649),segment_id=1e70bee6-dfc7-4037-8e59-6c6e25de8649)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:29:44.850188 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:44.852424 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:44.921447 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=e42a29cb-c29c-41f8-9cfb-6379c167a596,revision_number=7']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:44.924537 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:45.081435 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-eaa83d17-ec15-4eda-bb28-3b81e5a4a181 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-978269', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14907170', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14793691'] for subnet, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:45.086068 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:45.121485 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaa83d17-ec15-4eda-bb28-3b81e5a4a181 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fbc4ea0f-be4f-4d1c-a5f9-9c05726a34ab,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:45.123399 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-eaa83d17-ec15-4eda-bb28-3b81e5a4a181 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:45.126039 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-eaa83d17-ec15-4eda-bb28-3b81e5a4a181 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:45.128623 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80d645d3-f32d-4973-ac07-299aeb44de80 None None] Network 1148d900-6e78-4b1c-b565-d533f8532051 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:29:45.131179 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-eaa83d17-ec15-4eda-bb28-3b81e5a4a181 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/fbc4ea0f-be4f-4d1c-a5f9-9c05726a34ab HTTP/1.1" status: 204  len: 168 time: 0.5392156
May 31 16:29:45.133634 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 38654) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:45.352015 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-525980'] for network, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:45.401103 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bafeea24-f972-443f-994e-c24c441da708 None None] DHCP port deletion for 1148d900-6e78-4b1c-b565-d533f8532051 request from dv-cinder-793814-1-iscsi {{(pid=91765) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 31 16:29:45.431864 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] Deleting port 4af2bd35-f462-4d40-b558-8366735d7a77 {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:29:45.432519 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:45.484293 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-bafeea24-f972-443f-994e-c24c441da708 None None] Deleting port 4af2bd35-f462-4d40-b558-8366735d7a77 {{(pid=91765) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:29:45.484669 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-bafeea24-f972-443f-994e-c24c441da708 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:45.537991 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] For port 4af2bd35-f462-4d40-b558-8366735d7a77, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=4af2bd35-f462-4d40-b558-8366735d7a77,segment=NetworkSegment(82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996),segment_id=82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:29:45.538381 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:45.583792 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-bafeea24-f972-443f-994e-c24c441da708 None None] For port 4af2bd35-f462-4d40-b558-8366735d7a77, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=4af2bd35-f462-4d40-b558-8366735d7a77,segment=NetworkSegment(82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996),segment_id=82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:29:45.584405 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-bafeea24-f972-443f-994e-c24c441da708 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:45.663103 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] Calling delete_port for 4af2bd35-f462-4d40-b558-8366735d7a77 owned by network:dhcp {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:29:45.705017 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-bafeea24-f972-443f-994e-c24c441da708 None None] Calling delete_port for 4af2bd35-f462-4d40-b558-8366735d7a77 owned by network:dhcp {{(pid=91765) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:29:45.709806 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:45.713698 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-2de8536f-4688-4c99-b0bd-fbc83fcae673 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:45.748937 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-bafeea24-f972-443f-994e-c24c441da708 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907'] for port, after_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:45.752817 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:45.758864 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] Pushing event deleted for resources: {'Port': ['ID=4af2bd35-f462-4d40-b558-8366735d7a77,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:45.762152 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:45.762957 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] No DVR routers for this DVR port 4af2bd35-f462-4d40-b558-8366735d7a77 on host dv-cinder-793814-1-iscsi {{(pid=91764) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:29:45.832479 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bafeea24-f972-443f-994e-c24c441da708 None None] Pushing event deleted for resources: {'Port': ['ID=4af2bd35-f462-4d40-b558-8366735d7a77,revision_number=None']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:45.834310 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bafeea24-f972-443f-994e-c24c441da708 None None] No DVR routers for this DVR port 4af2bd35-f462-4d40-b558-8366735d7a77 on host dv-cinder-793814-1-iscsi {{(pid=91765) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:29:45.835679 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-bafeea24-f972-443f-994e-c24c441da708 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:45.885506 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-988775', 'neutron.services.segments.db._delete_segments_for_network-8732784586204'] for network, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:45.903318 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f14261acb50>,) {'filters': {'network_id': ['1148d900-6e78-4b1c-b565-d533f8532051']}} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:45.916238 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f14261acb50>, '82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996') {'for_net_delete': True} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:45.916464 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f14261acb50>, '82d98e28-d5cd-4e62-8bd2-8b7f0dd9a996') {} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:29:45.928656 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732784599197', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14907379'] for segment, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:45.945517 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:45.952074 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] Releasing vlan 826 on physical network physnet1 to pool {{(pid=91764) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 31 16:29:45.952639 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14905732'] for segment, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]: Traceback (most recent call last):
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:     timer()
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:     cb(*args, **kw)
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:     return func(*args, **kwargs)
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:     self._notify()
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:     self.callback(batched_events)
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:     event.method(event)
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:     aggregate_uuid = self.p_client.list_aggregates(
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:     return f(self, *a, **k)
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self._get(url).json()
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self.request(url, 'GET', **kwargs)
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:     base_url = self.get_endpoint(auth, allow=allow,
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 31 16:29:45.966282 dv-cinder-793814-1-iscsi neutron-server[91764]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 31 16:29:46.043400 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16621775'] for network, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:46.047044 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:46.065840 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:46.076168 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] Pushing event deleted for resources: {'Network': ['ID=1148d900-6e78-4b1c-b565-d533f8532051,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:46.079235 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:46.080744 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-6d3ed188-e000-49f8-9434-0023a41c644b admin admin] 10.222.0.43 "DELETE /v2.0/networks/1148d900-6e78-4b1c-b565-d533f8532051 HTTP/1.1" status: 204  len: 168 time: 0.9459949
May 31 16:29:46.260865 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 38666) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:46.309554 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-6132b9c5-5aef-422a-924e-41af585d00bf admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=092115f69b8e401b8c334f7b3e797aad&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0474598
May 31 16:29:46.311879 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 38670) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:46.369838 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bcb9c86b-35b5-4b5a-8429-5201dfef7eea admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:46.397867 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bcb9c86b-35b5-4b5a-8429-5201dfef7eea admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:46.452216 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 4af2bd35-f462-4d40-b558-8366735d7a77 no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:29:46.458947 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bcb9c86b-35b5-4b5a-8429-5201dfef7eea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:46.464999 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-5fb2a352-2a83-43f6-8720-2255075cda9f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:46.478336 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcb9c86b-35b5-4b5a-8429-5201dfef7eea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0334ae0f-69e2-435f-8cca-c6e8551245b4,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:46.480860 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-bcb9c86b-35b5-4b5a-8429-5201dfef7eea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:46.487319 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: 4af2bd35-f462-4d40-b558-8366735d7a77 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:29:46.487922 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 4af2bd35-f462-4d40-b558-8366735d7a77 not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:29:46.491369 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-bcb9c86b-35b5-4b5a-8429-5201dfef7eea admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:46.492502 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-bcb9c86b-35b5-4b5a-8429-5201dfef7eea admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/0334ae0f-69e2-435f-8cca-c6e8551245b4 HTTP/1.1" status: 204  len: 168 time: 0.1797359
May 31 16:29:46.636940 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['e42a29cb-c29c-41f8-9cfb-6379c167a596'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:29:46.864774 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 38680) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:46.918499 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-be6676e5-7311-458b-b1b5-3b54a3080f14 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=d632158d834f4af7851eaec17fb0b06f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0520391
May 31 16:29:46.922511 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 38684) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:46.982149 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e80853e5-93a3-4281-8fc0-26a32ae3227f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:47.010675 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e80853e5-93a3-4281-8fc0-26a32ae3227f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:47.063935 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e80853e5-93a3-4281-8fc0-26a32ae3227f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:47.069393 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-fb358ebf-a398-4c52-9180-abc2138a31ac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:47.085125 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e80853e5-93a3-4281-8fc0-26a32ae3227f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=86169464-e9de-4997-a4b4-9fdec28e2439,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:47.089454 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-e80853e5-93a3-4281-8fc0-26a32ae3227f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:47.093209 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e80853e5-93a3-4281-8fc0-26a32ae3227f admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:47.097246 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-e80853e5-93a3-4281-8fc0-26a32ae3227f admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/86169464-e9de-4997-a4b4-9fdec28e2439 HTTP/1.1" status: 204  len: 168 time: 0.1738038
May 31 16:29:48.392772 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device e42a29cb-c29c-41f8-9cfb-6379c167a596 up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:29:48.464467 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port e42a29cb-c29c-41f8-9cfb-6379c167a596 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:29:48.464846 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:48.585074 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:48.596830 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 38714) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:48.627400 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd9e580af-3588-40d6-9e2a-60c321af3d1e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e42a29cb-c29c-41f8-9cfb-6379c167a596'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:29:48.631853 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-90c5d7e4-ef1e-4548-89f1-67a4e3b42a6c" -d '{"events": [{"server_uuid": "d9e580af-3588-40d6-9e2a-60c321af3d1e", "name": "network-vif-plugged", "status": "completed", "tag": "e42a29cb-c29c-41f8-9cfb-6379c167a596"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:29:48.644868 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port e42a29cb-c29c-41f8-9cfb-6379c167a596, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=e42a29cb-c29c-41f8-9cfb-6379c167a596,segment=NetworkSegment(1e70bee6-dfc7-4037-8e59-6c6e25de8649),segment_id=1e70bee6-dfc7-4037-8e59-6c6e25de8649)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:29:48.650236 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:48.652995 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:48.714715 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:29:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b03067c9-0ee5-4039-95ea-32ca38be77e6 x-openstack-request-id: req-b03067c9-0ee5-4039-95ea-32ca38be77e6 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:29:48.715128 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d9e580af-3588-40d6-9e2a-60c321af3d1e", "name": "network-vif-plugged", "status": "completed", "tag": "e42a29cb-c29c-41f8-9cfb-6379c167a596", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:29:48.715497 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-b03067c9-0ee5-4039-95ea-32ca38be77e6 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:29:48.715983 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd9e580af-3588-40d6-9e2a-60c321af3d1e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e42a29cb-c29c-41f8-9cfb-6379c167a596', 'code': 200}
May 31 16:29:48.736804 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=e42a29cb-c29c-41f8-9cfb-6379c167a596,revision_number=8']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:48.743365 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:48.773951 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-90ff81c2-c8c2-42be-8797-1f6107971c62 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:48.790639 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-90ff81c2-c8c2-42be-8797-1f6107971c62 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:29:48.794595 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-90ff81c2-c8c2-42be-8797-1f6107971c62 admin admin] Usage tracker for resource:security_group_rule and tenant:4cd205b21b2a4f8ab34fa7372c4f5577 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:29:48.797515 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-90ff81c2-c8c2-42be-8797-1f6107971c62 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:29:48.803345 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-90ff81c2-c8c2-42be-8797-1f6107971c62 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:29:48.895370 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-90ff81c2-c8c2-42be-8797-1f6107971c62 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:48.899355 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-90ff81c2-c8c2-42be-8797-1f6107971c62 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:48.911455 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-baac96b5-05e8-408b-9ecd-7dde8711bc4a tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:48.952386 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-90ff81c2-c8c2-42be-8797-1f6107971c62 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=4cd205b21b2a4f8ab34fa7372c4f5577&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3537753
May 31 16:29:48.954153 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90ff81c2-c8c2-42be-8797-1f6107971c62 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88abe258-40c5-4b52-ae60-2b8388ff0243,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:48.955054 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 38726) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:48.958464 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-90ff81c2-c8c2-42be-8797-1f6107971c62 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:49.023940 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d58aa38e-31ca-4f47-99a7-2f3b7a552a6f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:49.049852 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d58aa38e-31ca-4f47-99a7-2f3b7a552a6f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:49.122587 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d58aa38e-31ca-4f47-99a7-2f3b7a552a6f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:49.122587 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-216c063a-8f32-4c52-a6c0-ce091660135e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:49.138795 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d58aa38e-31ca-4f47-99a7-2f3b7a552a6f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88abe258-40c5-4b52-ae60-2b8388ff0243,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:49.141625 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d58aa38e-31ca-4f47-99a7-2f3b7a552a6f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:49.150254 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-d58aa38e-31ca-4f47-99a7-2f3b7a552a6f admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:49.154354 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-d58aa38e-31ca-4f47-99a7-2f3b7a552a6f admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/88abe258-40c5-4b52-ae60-2b8388ff0243 HTTP/1.1" status: 204  len: 168 time: 0.1976688
May 31 16:29:49.693981 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:50.171368 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:29:50.992870 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 38790) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:51.112424 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-00a08922-2407-493e-8bea-c0d83fa1a8af admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:51.127401 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-00a08922-2407-493e-8bea-c0d83fa1a8af admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:29:51.132054 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-00a08922-2407-493e-8bea-c0d83fa1a8af admin admin] Usage tracker for resource:security_group_rule and tenant:5718e8e1a6ca4c20bc4d584807a0f40e is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:29:51.135005 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-00a08922-2407-493e-8bea-c0d83fa1a8af admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:29:51.140577 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-00a08922-2407-493e-8bea-c0d83fa1a8af admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:29:51.224930 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-00a08922-2407-493e-8bea-c0d83fa1a8af admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:51.228543 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-00a08922-2407-493e-8bea-c0d83fa1a8af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:51.234889 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-07867e87-a75c-4350-b686-feb2d958fafb tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:51.279367 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00a08922-2407-493e-8bea-c0d83fa1a8af admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b1035e2c-55a8-4225-bb99-725286a1c047,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:51.286090 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-00a08922-2407-493e-8bea-c0d83fa1a8af admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=5718e8e1a6ca4c20bc4d584807a0f40e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2897911
May 31 16:29:51.286090 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-00a08922-2407-493e-8bea-c0d83fa1a8af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:51.287210 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 38796) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:51.346209 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-25beb2a1-5afe-4b04-936e-aa6ddf6d5f7e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:51.372452 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-25beb2a1-5afe-4b04-936e-aa6ddf6d5f7e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:51.422727 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-25beb2a1-5afe-4b04-936e-aa6ddf6d5f7e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:51.428224 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-6d6e83f8-b625-4f32-a630-6dabfc1b7c72 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:51.440676 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25beb2a1-5afe-4b04-936e-aa6ddf6d5f7e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1035e2c-55a8-4225-bb99-725286a1c047,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:51.443616 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-25beb2a1-5afe-4b04-936e-aa6ddf6d5f7e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:51.444546 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-25beb2a1-5afe-4b04-936e-aa6ddf6d5f7e admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:51.447593 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-25beb2a1-5afe-4b04-936e-aa6ddf6d5f7e admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/b1035e2c-55a8-4225-bb99-725286a1c047 HTTP/1.1" status: 204  len: 168 time: 0.1594098
May 31 16:29:51.725910 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 38804) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:51.743569 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-f8dc5498-941c-4e99-8095-41eecbe59e36 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:51.758154 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-f8dc5498-941c-4e99-8095-41eecbe59e36 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:29:51.761975 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-f8dc5498-941c-4e99-8095-41eecbe59e36 admin admin] Usage tracker for resource:security_group_rule and tenant:7abd5b2639524fff94ca994e59b29186 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:29:51.764787 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-f8dc5498-941c-4e99-8095-41eecbe59e36 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:29:51.771181 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-f8dc5498-941c-4e99-8095-41eecbe59e36 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:29:51.855152 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-f8dc5498-941c-4e99-8095-41eecbe59e36 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:51.860159 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-f8dc5498-941c-4e99-8095-41eecbe59e36 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:51.882192 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-7bce354d-a6ec-4b55-aacf-ded5d8101cb7 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:51.944984 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-f8dc5498-941c-4e99-8095-41eecbe59e36 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=7abd5b2639524fff94ca994e59b29186&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2179756
May 31 16:29:51.946038 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8dc5498-941c-4e99-8095-41eecbe59e36 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2d6b470b-25db-481f-a9b6-aecded2282a3,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:51.947765 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 38810) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:51.949603 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-f8dc5498-941c-4e99-8095-41eecbe59e36 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:52.013208 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-1b28860a-754f-445d-9b7e-3d883dd31e40 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:52.038962 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-1b28860a-754f-445d-9b7e-3d883dd31e40 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:52.090898 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-1b28860a-754f-445d-9b7e-3d883dd31e40 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:52.094916 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-bdc20f59-65cc-415e-88ce-d102ea00d7e0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:52.107117 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b28860a-754f-445d-9b7e-3d883dd31e40 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d6b470b-25db-481f-a9b6-aecded2282a3,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:52.109379 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-1b28860a-754f-445d-9b7e-3d883dd31e40 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:52.119652 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-1b28860a-754f-445d-9b7e-3d883dd31e40 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:52.120813 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-1b28860a-754f-445d-9b7e-3d883dd31e40 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/2d6b470b-25db-481f-a9b6-aecded2282a3 HTTP/1.1" status: 204  len: 168 time: 0.1720669
May 31 16:29:57.652386 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 38928) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:57.768396 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:57.782976 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:29:57.786866 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] Usage tracker for resource:security_group_rule and tenant:5ff82dee9c8e448dba96697b0aa4a0fd is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:29:57.789730 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:29:57.795318 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:29:57.887939 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:57.893070 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:57.903290 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-448387cf-64d8-4f8a-a62a-109265ba6d8a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:57.944555 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d300637c-0e62-41d6-825e-6297cd358807,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:57.948622 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=5ff82dee9c8e448dba96697b0aa4a0fd&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2952359
May 31 16:29:57.951495 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 38940) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:57.954934 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:57.955278 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:57.955652 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:57.956013 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:57.959538 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:57.959538 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:57.959538 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:57.959538 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:57.959538 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:57.959538 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:57.959538 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:57.959538 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:29:57.963915 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-e909af1e-2a64-42ae-a567-d14c9be2010b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:58.031757 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9cc32c3d-db3f-42a8-af70-3c1930a1b47e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:58.058385 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9cc32c3d-db3f-42a8-af70-3c1930a1b47e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:58.109794 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9cc32c3d-db3f-42a8-af70-3c1930a1b47e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:58.113671 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-629cf5a6-4d92-44d5-b0dd-7aae96415e34 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:58.127254 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cc32c3d-db3f-42a8-af70-3c1930a1b47e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d300637c-0e62-41d6-825e-6297cd358807,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:58.131743 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-9cc32c3d-db3f-42a8-af70-3c1930a1b47e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:58.137012 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-9cc32c3d-db3f-42a8-af70-3c1930a1b47e admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:58.140378 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-9cc32c3d-db3f-42a8-af70-3c1930a1b47e admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/d300637c-0e62-41d6-825e-6297cd358807 HTTP/1.1" status: 204  len: 168 time: 0.1857052
May 31 16:29:58.423664 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 38948) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:58.441648 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-10fdd25b-7500-46ea-a780-e1c4c318460d admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:58.455752 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-10fdd25b-7500-46ea-a780-e1c4c318460d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:29:58.460082 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-10fdd25b-7500-46ea-a780-e1c4c318460d admin admin] Usage tracker for resource:security_group_rule and tenant:ef70282680fd42a187ea43e638abedc3 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:29:58.462927 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-10fdd25b-7500-46ea-a780-e1c4c318460d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:29:58.468541 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-10fdd25b-7500-46ea-a780-e1c4c318460d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:29:58.551859 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-10fdd25b-7500-46ea-a780-e1c4c318460d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:58.555636 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-10fdd25b-7500-46ea-a780-e1c4c318460d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:58.564348 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-cd7dc232-48c1-462f-85ed-6fc5fff20d4a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:58.604047 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-10fdd25b-7500-46ea-a780-e1c4c318460d admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=ef70282680fd42a187ea43e638abedc3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1791615
May 31 16:29:58.605546 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10fdd25b-7500-46ea-a780-e1c4c318460d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4b3f37b1-b861-447b-a3c4-34ecb84f5883,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:58.606846 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 38952) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:58.608546 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-10fdd25b-7500-46ea-a780-e1c4c318460d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:58.671712 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-03fc749a-0e34-4aac-a596-95e130dcc5fa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:58.778883 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-03fc749a-0e34-4aac-a596-95e130dcc5fa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:58.832105 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-03fc749a-0e34-4aac-a596-95e130dcc5fa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:58.836085 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d58aa38e-31ca-4f47-99a7-2f3b7a552a6f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:58.850933 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03fc749a-0e34-4aac-a596-95e130dcc5fa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4b3f37b1-b861-447b-a3c4-34ecb84f5883,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:58.853490 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-03fc749a-0e34-4aac-a596-95e130dcc5fa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:58.854778 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-03fc749a-0e34-4aac-a596-95e130dcc5fa admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:58.856308 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-03fc749a-0e34-4aac-a596-95e130dcc5fa admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/4b3f37b1-b861-447b-a3c4-34ecb84f5883 HTTP/1.1" status: 204  len: 168 time: 0.2473013
May 31 16:29:59.224679 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 38966) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:59.242873 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-49b43033-384d-42ec-900e-4d1746399d26 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:59.257860 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-49b43033-384d-42ec-900e-4d1746399d26 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:29:59.261695 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-49b43033-384d-42ec-900e-4d1746399d26 admin admin] Usage tracker for resource:security_group_rule and tenant:a76bd8233d8f4d26bdea8393ad2bcbf3 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:29:59.264486 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-49b43033-384d-42ec-900e-4d1746399d26 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:29:59.270916 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-49b43033-384d-42ec-900e-4d1746399d26 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:29:59.353593 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-49b43033-384d-42ec-900e-4d1746399d26 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:59.357458 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-49b43033-384d-42ec-900e-4d1746399d26 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:59.365928 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-fbbf6c4f-32cf-48e8-b5d7-b6dffb34f534 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:59.405874 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-49b43033-384d-42ec-900e-4d1746399d26 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=a76bd8233d8f4d26bdea8393ad2bcbf3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1800268
May 31 16:29:59.407381 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49b43033-384d-42ec-900e-4d1746399d26 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=940d49c0-373c-46b4-aa66-358710912876,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:59.408522 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 38970) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:29:59.410411 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-49b43033-384d-42ec-900e-4d1746399d26 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:59.478090 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-8749b2ee-0b5d-43ae-b03f-cf3bc92c3dbd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:59.503501 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-8749b2ee-0b5d-43ae-b03f-cf3bc92c3dbd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:59.555714 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-8749b2ee-0b5d-43ae-b03f-cf3bc92c3dbd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:59.559408 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-50b0bbb8-b8b8-4754-a94a-9c358eb771bb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:29:59.571942 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8749b2ee-0b5d-43ae-b03f-cf3bc92c3dbd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=940d49c0-373c-46b4-aa66-358710912876,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:29:59.575796 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-8749b2ee-0b5d-43ae-b03f-cf3bc92c3dbd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:29:59.587510 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-8749b2ee-0b5d-43ae-b03f-cf3bc92c3dbd admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:29:59.588788 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-8749b2ee-0b5d-43ae-b03f-cf3bc92c3dbd admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/940d49c0-373c-46b4-aa66-358710912876 HTTP/1.1" status: 204  len: 168 time: 0.1750836
May 31 16:30:00.559120 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 39006) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:30:00.681257 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ad8b7ab9-603d-4cb4-bde7-92a5cd37eb54 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:00.699676 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-ad8b7ab9-603d-4cb4-bde7-92a5cd37eb54 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:30:00.703574 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-ad8b7ab9-603d-4cb4-bde7-92a5cd37eb54 admin admin] Usage tracker for resource:security_group_rule and tenant:8c92aa4caf3843e7beaee1fb69f32889 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:30:00.707895 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [None req-ad8b7ab9-603d-4cb4-bde7-92a5cd37eb54 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:30:00.714920 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [None req-ad8b7ab9-603d-4cb4-bde7-92a5cd37eb54 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:30:00.802150 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ad8b7ab9-603d-4cb4-bde7-92a5cd37eb54 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:00.806122 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ad8b7ab9-603d-4cb4-bde7-92a5cd37eb54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:00.813478 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-0dbe8ea6-3c45-459c-baf2-6d9431482aeb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:00.856540 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-ad8b7ab9-603d-4cb4-bde7-92a5cd37eb54 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=8c92aa4caf3843e7beaee1fb69f32889&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2962008
May 31 16:30:00.857313 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad8b7ab9-603d-4cb4-bde7-92a5cd37eb54 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9ba4169b-f920-460d-8cf7-dd74b34e6d3f,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:00.859999 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 39022) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:30:00.860510 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-ad8b7ab9-603d-4cb4-bde7-92a5cd37eb54 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:00.920538 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ae5d7f40-dec0-4945-aede-0d1015379e97 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:00.948143 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ae5d7f40-dec0-4945-aede-0d1015379e97 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:01.010465 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ae5d7f40-dec0-4945-aede-0d1015379e97 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:01.014436 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-f32c9e4b-4d4e-45bf-b172-47c0c2748773 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:01.025375 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae5d7f40-dec0-4945-aede-0d1015379e97 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9ba4169b-f920-460d-8cf7-dd74b34e6d3f,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:01.029324 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-ae5d7f40-dec0-4945-aede-0d1015379e97 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:01.032706 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-ae5d7f40-dec0-4945-aede-0d1015379e97 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:01.033845 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-ae5d7f40-dec0-4945-aede-0d1015379e97 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/9ba4169b-f920-460d-8cf7-dd74b34e6d3f HTTP/1.1" status: 204  len: 168 time: 0.1718798
May 31 16:30:01.780229 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 39080) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:30:01.899400 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b5689837-0232-4af6-b1d7-ba838b1b0c53 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:01.914726 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-b5689837-0232-4af6-b1d7-ba838b1b0c53 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:30:01.918743 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-b5689837-0232-4af6-b1d7-ba838b1b0c53 admin admin] Usage tracker for resource:security_group_rule and tenant:0975eef1ecee47269a8b1ae82c63e73f is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:30:01.921648 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-b5689837-0232-4af6-b1d7-ba838b1b0c53 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:30:01.928420 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-b5689837-0232-4af6-b1d7-ba838b1b0c53 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:30:02.016236 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b5689837-0232-4af6-b1d7-ba838b1b0c53 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:02.020314 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-b5689837-0232-4af6-b1d7-ba838b1b0c53 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:02.028939 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-e80853e5-93a3-4281-8fc0-26a32ae3227f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:02.070193 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-b5689837-0232-4af6-b1d7-ba838b1b0c53 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=0975eef1ecee47269a8b1ae82c63e73f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2888212
May 31 16:30:02.071127 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5689837-0232-4af6-b1d7-ba838b1b0c53 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b78a90e5-562d-460f-b4e3-1cc2e1d4b154,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:02.073006 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 39090) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:30:02.074182 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-b5689837-0232-4af6-b1d7-ba838b1b0c53 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:02.148912 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6808127a-a5fb-402b-bb0e-bff4bcba323c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:02.175414 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6808127a-a5fb-402b-bb0e-bff4bcba323c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:02.250306 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6808127a-a5fb-402b-bb0e-bff4bcba323c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:02.256986 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-63764b3e-bc5c-447d-a20a-222b87bf4b48 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:02.276571 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6808127a-a5fb-402b-bb0e-bff4bcba323c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b78a90e5-562d-460f-b4e3-1cc2e1d4b154,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:02.280535 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-6808127a-a5fb-402b-bb0e-bff4bcba323c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:02.295804 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-6808127a-a5fb-402b-bb0e-bff4bcba323c admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:02.299519 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-6808127a-a5fb-402b-bb0e-bff4bcba323c admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/b78a90e5-562d-460f-b4e3-1cc2e1d4b154 HTTP/1.1" status: 204  len: 168 time: 0.2253506
May 31 16:30:02.594275 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 39102) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:30:02.615215 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-7175bb1a-4e36-450f-96db-8222e2bbb032 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:02.632514 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-7175bb1a-4e36-450f-96db-8222e2bbb032 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:30:02.636457 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-7175bb1a-4e36-450f-96db-8222e2bbb032 admin admin] Usage tracker for resource:security_group_rule and tenant:7d9b531608294f108b7991e0407ac11c is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:30:02.639274 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-7175bb1a-4e36-450f-96db-8222e2bbb032 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:30:02.645472 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-7175bb1a-4e36-450f-96db-8222e2bbb032 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:30:02.737743 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-7175bb1a-4e36-450f-96db-8222e2bbb032 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:02.741980 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-7175bb1a-4e36-450f-96db-8222e2bbb032 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:02.748916 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-37bb9ad9-62d1-405d-9e18-b9fb1d889dea admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:02.791911 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-7175bb1a-4e36-450f-96db-8222e2bbb032 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=7d9b531608294f108b7991e0407ac11c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1965604
May 31 16:30:02.792841 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7175bb1a-4e36-450f-96db-8222e2bbb032 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b6ef9c6-a428-4855-9e7a-58b298eb02e4,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:02.794808 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 39106) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:30:02.795893 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-7175bb1a-4e36-450f-96db-8222e2bbb032 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:02.853540 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-c931182c-040c-4c05-8a29-dcc25532d2e1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:02.879830 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-c931182c-040c-4c05-8a29-dcc25532d2e1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:02.931625 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-c931182c-040c-4c05-8a29-dcc25532d2e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:02.936374 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-076208dd-6b2d-4a01-9a57-46c5261667ba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:02.949003 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c931182c-040c-4c05-8a29-dcc25532d2e1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b6ef9c6-a428-4855-9e7a-58b298eb02e4,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:02.951815 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-c931182c-040c-4c05-8a29-dcc25532d2e1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:02.952870 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-c931182c-040c-4c05-8a29-dcc25532d2e1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:02.954416 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-c931182c-040c-4c05-8a29-dcc25532d2e1 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/3b6ef9c6-a428-4855-9e7a-58b298eb02e4 HTTP/1.1" status: 204  len: 168 time: 0.1580594
May 31 16:30:03.685670 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-cbe0116c-c077-40ac-b2bd-805cb2ddddd0 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/networks?tenant_id=50928f153a3147309c906abd6dba60d7&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0282278
May 31 16:30:03.686750 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 39144) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:30:03.794282 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-127966828-network', 'tenant_id': 'be6bbbcf37dc490480d276accbb4a108'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:30:03.802789 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:30:03.818248 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Usage tracker for resource:network and tenant:be6bbbcf37dc490480d276accbb4a108 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:30:03.823530 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:30:03.834255 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:30:03.861204 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90524d1d-84ab-4787-a5f3-773ee9839fdc tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:03.862642 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90524d1d-84ab-4787-a5f3-773ee9839fdc tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.1699414
May 31 16:30:03.864022 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Made reservation on behalf of be6bbbcf37dc490480d276accbb4a108 for: {'network': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:30:03.866236 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-639279'] for network, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:03.887034 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:03.897405 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-bb83c703-3a1f-4494-8632-da272125d210 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/quotas/50928f153a3147309c906abd6dba60d7 HTTP/1.1" status: 200  len: 375 time: 0.0221558
May 31 16:30:03.904890 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:30:03.944886 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Usage tracker for resource:security_group_rule and tenant:be6bbbcf37dc490480d276accbb4a108 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:30:04.040983 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:30:04.045390 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-37db7ddc-aa48-40e3-b780-4e0fcd0fe213 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=50928f153a3147309c906abd6dba60d7&fields=id HTTP/1.1" status: 200  len: 210 time: 0.1416414
May 31 16:30:04.048874 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:30:04.139886 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:04.144342 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:04.149939 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-af9fec02-207b-4185-af88-9d30606cf08f tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:04.178796 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 847}  {{(pid=91764) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 31 16:30:04.193734 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0cc7c395-a53f-46a5-877c-c098be2d3279,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:04.196849 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:04.201244 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:04.201628 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.db.segments_db [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Added segment a23fa11b-36ad-446f-bbcc-5f71f4a7c045 of type vlan for network 9526c501-6f8f-4f53-8d14-c5917c4cfa9e
May 31 16:30:04.229554 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732784079930'] for network, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:04.259855 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366'] for network, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:04.261357 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:04.261959 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:04.266751 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:04.411791 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-5073ef17-b824-4227-b0a5-e95b8d6f0792 req-918d10e8-84cc-41f1-806f-795f028f0ec5 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/ports?device_id=06a5ad82-8d5e-4b30-b2b7-b9549538ab75 HTTP/1.1" status: 200  len: 210 time: 0.2283010
May 31 16:30:04.420248 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Pushing event updated for resources: {'Network': ['ID=9526c501-6f8f-4f53-8d14-c5917c4cfa9e,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:04.423618 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:04.426419 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-2f25df7b-4fa4-4342-9558-11434f3dd2ff admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 0.7378411
May 31 16:30:04.429171 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 39154) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:30:04.434740 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [None req-d11e03a7-3fe6-44ef-8a59-ee72d504bf90 admin admin] Request body: {'subnet': {'network_id': '9526c501-6f8f-4f53-8d14-c5917c4cfa9e', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-127966828-subnet', 'tenant_id': 'be6bbbcf37dc490480d276accbb4a108', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:30:04.434894 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Network 9526c501-6f8f-4f53-8d14-c5917c4cfa9e details requested by agent ovs-agent-dv-cinder-793814-1-iscsi with host dv-cinder-793814-1-iscsi {{(pid=91765) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 31 16:30:04.439659 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-d11e03a7-3fe6-44ef-8a59-ee72d504bf90 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:30:04.444202 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-d11e03a7-3fe6-44ef-8a59-ee72d504bf90 admin admin] Usage tracker for resource:subnet and tenant:be6bbbcf37dc490480d276accbb4a108 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:30:04.447080 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-d11e03a7-3fe6-44ef-8a59-ee72d504bf90 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:30:04.452787 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-d11e03a7-3fe6-44ef-8a59-ee72d504bf90 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:30:04.463132 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d11e03a7-3fe6-44ef-8a59-ee72d504bf90 admin admin] Made reservation on behalf of be6bbbcf37dc490480d276accbb4a108 for: {'subnet': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:30:04.465412 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-d11e03a7-3fe6-44ef-8a59-ee72d504bf90 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14793668'] for subnet, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:04.846083 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-d11e03a7-3fe6-44ef-8a59-ee72d504bf90 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-14907233', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14793682'] for subnet, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:04.851415 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-aa4da925-1a9b-4dcc-9736-87213d0d7a9c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:04.927418 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d11e03a7-3fe6-44ef-8a59-ee72d504bf90 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c3ef4bfd-26df-47c9-b849-a7ffdc14c690,revision_number=0']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:04.931453 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-d11e03a7-3fe6-44ef-8a59-ee72d504bf90 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:04.935572 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d11e03a7-3fe6-44ef-8a59-ee72d504bf90 admin admin] Checking segment: {'id': 'a23fa11b-36ad-446f-bbcc-5f71f4a7c045', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 847, 'network_id': '9526c501-6f8f-4f53-8d14-c5917c4cfa9e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:30:04.935929 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d11e03a7-3fe6-44ef-8a59-ee72d504bf90 admin admin] Network hostable DHCP agents. Network: 9526c501-6f8f-4f53-8d14-c5917c4cfa9e, hostable agents: ['5c9859e8-5965-4c86-8b2b-8fab235cbf66'], hosted agents: [] {{(pid=91764) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 31 16:30:04.952976 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d11e03a7-3fe6-44ef-8a59-ee72d504bf90 admin admin] Network 9526c501-6f8f-4f53-8d14-c5917c4cfa9e is scheduled to be hosted by DHCP agent 5c9859e8-5965-4c86-8b2b-8fab235cbf66 with binding_index 1 {{(pid=91764) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 31 16:30:04.971093 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [None req-d11e03a7-3fe6-44ef-8a59-ee72d504bf90 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793814-1-iscsi, 9526c501-6f8f-4f53-8d14-c5917c4cfa9e) {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:30:04.981085 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d11e03a7-3fe6-44ef-8a59-ee72d504bf90 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:04.981399 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8035678-a704-4b0a-9b35-c15b9dc93379 None None] Network 9526c501-6f8f-4f53-8d14-c5917c4cfa9e requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:30:04.981720 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-d11e03a7-3fe6-44ef-8a59-ee72d504bf90 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:05.009587 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-d11e03a7-3fe6-44ef-8a59-ee72d504bf90 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.5743248
May 31 16:30:05.071661 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-bb857bca-3027-4db6-bf07-ab901be79da2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:05.196900 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2623b1cb-1b87-4e7f-bd5e-4429ae347b86 None None] Network 9526c501-6f8f-4f53-8d14-c5917c4cfa9e requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:30:05.573625 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a1fbc2de-4ba8-46c5-ba9d-2528ba38b2b2 req-b609d0bf-eadb-4c34-8c66-68d2280d8a51 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/ports?device_id=06a5ad82-8d5e-4b30-b2b7-b9549538ab75 HTTP/1.1" status: 200  len: 210 time: 0.1088181
May 31 16:30:06.727644 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-954e58b0-d327-4a59-a7ce-040797d761c3 req-f1119d79-c8b8-439b-b9fd-69941693146c tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/ports?device_id=06a5ad82-8d5e-4b30-b2b7-b9549538ab75 HTTP/1.1" status: 200  len: 210 time: 0.0464213
May 31 16:30:07.065266 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-7f9ce18b-eab3-4a49-b9a8-98807b3c2916 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:07.065975 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-7f9ce18b-eab3-4a49-b9a8-98807b3c2916 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Synchronizing usage tracker for tenant:be6bbbcf37dc490480d276accbb4a108 on resource:network {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:30:07.083963 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-7f9ce18b-eab3-4a49-b9a8-98807b3c2916 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Unset dirty status for tenant:be6bbbcf37dc490480d276accbb4a108 on resource:network {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:30:07.085359 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-7f9ce18b-eab3-4a49-b9a8-98807b3c2916 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/networks?id=9526c501-6f8f-4f53-8d14-c5917c4cfa9e HTTP/1.1" status: 200  len: 808 time: 0.1665082
May 31 16:30:07.102782 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-58184014-e5e2-4438-92d7-ed8718cc3bbb tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/quotas/be6bbbcf37dc490480d276accbb4a108 HTTP/1.1" status: 200  len: 375 time: 0.0117679
May 31 16:30:07.153489 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-ff6cffeb-a052-437d-a785-0a95bd9951e2 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=be6bbbcf37dc490480d276accbb4a108&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0452967
May 31 16:30:07.164729 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-9e9c8c11-4c30-4b33-843e-647512f0dce4 service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=91764) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 31 16:30:07.165720 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-9e9c8c11-4c30-4b33-843e-647512f0dce4 service neutron] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0058634
May 31 16:30:07.301323 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-3cd7cecf-355b-4191-a858-fb948c883e91 service neutron] 10.222.0.43 "GET /v2.0/networks/9526c501-6f8f-4f53-8d14-c5917c4cfa9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1295609
May 31 16:30:07.435398 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-ee9425e3-9d15-4944-9c24-a76dcdc8b883 service neutron] 10.222.0.43 "GET /v2.0/networks/9526c501-6f8f-4f53-8d14-c5917c4cfa9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1284380
May 31 16:30:07.494377 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-41d16ac5-9bd9-4a30-b7ef-eaa61908ce5a tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.63 "GET /v2.0/networks?tenant_id=50928f153a3147309c906abd6dba60d7&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0296195
May 31 16:30:07.646713 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-72942d52-9ad8-4652-b20e-cde0a47f5cdc req-5e230280-c048-4383-a316-94983a276142 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=f7619b67-f2eb-4db8-8554-87b1e555294e HTTP/1.1" status: 200  len: 210 time: 0.0610328
May 31 16:30:07.819018 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-4ed2c800-100a-43c2-bca6-b39014d04a59 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:07.820480 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-4ed2c800-100a-43c2-bca6-b39014d04a59 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.63 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.3198287
May 31 16:30:07.837063 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Request body: {'port': {'device_id': '06a5ad82-8d5e-4b30-b2b7-b9549538ab75', 'network_id': '212ab211-7c76-4934-acfc-01c978c3aca3', 'admin_state_up': True, 'tenant_id': '50928f153a3147309c906abd6dba60d7'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:30:07.914865 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:07.954637 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-ad718c92-4410-41d2-94f0-7a80f089a409 req-7a53736a-ca3d-42d6-8185-dbb922a10c84 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/ports?device_id=06a5ad82-8d5e-4b30-b2b7-b9549538ab75 HTTP/1.1" status: 200  len: 210 time: 0.1012516
May 31 16:30:08.022979 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:30:08.026792 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Usage tracker for resource:port and tenant:50928f153a3147309c906abd6dba60d7 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:30:08.029667 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:30:08.036337 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:30:08.046457 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Made reservation on behalf of 50928f153a3147309c906abd6dba60d7 for: {'port': 1} {{(pid=91764) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:30:08.050276 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:08.063488 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:08.079913 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:30:08.084498 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Usage tracker for resource:security_group_rule and tenant:50928f153a3147309c906abd6dba60d7 is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:30:08.087417 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:30:08.093361 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:30:08.202652 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:08.207223 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:08.211910 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-422bc1f4-d376-4911-ae08-0ec3a7846a89 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:08.234615 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-ad71844c-3e96-4ce5-80a3-88571db6693f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:08.306577 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b4f00906-9032-43c7-9ede-5a8cb87efb07,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:08.309616 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:08.392419 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_common [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Allocated IP 192.168.233.13 (212ab211-7c76-4934-acfc-01c978c3aca3/47a67de8-eac8-4eef-b09c-ca63cc33d90c/1f5ab677-aa60-4175-a0b1-db3a8d80bdb7) {{(pid=91764) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:30:08.596896 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Notify callbacks [] for port, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:08.612651 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.provisioning_blocks [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Transition to ACTIVE for port object 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 will not be triggered until provisioned by entity DHCP. {{(pid=91764) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:30:08.639467 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:08.645775 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-10cabc4b-330b-457d-90f6-123c500ba195 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:08.716223 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Pushing event updated for resources: {'Port': ['ID=1f5ab677-aa60-4175-a0b1-db3a8d80bdb7,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:08.720674 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:08.731162 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Network 212ab211-7c76-4934-acfc-01c978c3aca3 is already hosted by enough agents. {{(pid=91764) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:30:08.732324 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.base_scheduler [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Resources bound (agent type, host, resource id):  {{(pid=91764) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:30:08.734689 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.l3_dvrscheduler_db [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Received port after_create {{(pid=91764) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:30:08.801889 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-be4cefcb-263a-4f83-a512-7329a91fb017 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:08.803412 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-be4cefcb-263a-4f83-a512-7329a91fb017 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.63 "GET /v2.0/networks?id=9526c501-6f8f-4f53-8d14-c5917c4cfa9e HTTP/1.1" status: 200  len: 808 time: 0.1644766
May 31 16:30:08.807214 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:08.807856 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:08.821947 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-62720a6b-e4cb-4fa5-af29-4d91bac88f3c tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Request body: {'port': {'device_id': 'f7619b67-f2eb-4db8-8554-87b1e555294e', 'network_id': '9526c501-6f8f-4f53-8d14-c5917c4cfa9e', 'admin_state_up': True, 'tenant_id': 'be6bbbcf37dc490480d276accbb4a108'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:30:08.865703 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1bca0d69-9046-47d2-af52-e16690bc4f8d req-93f23145-c6a6-44af-9fb8-876be034f1fb tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=f7619b67-f2eb-4db8-8554-87b1e555294e HTTP/1.1" status: 200  len: 210 time: 0.0535192
May 31 16:30:08.897205 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-90fa943d-3335-4972-b1b9-fa13c5fa4648 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.63 "POST /v2.0/ports HTTP/1.1" status: 201  len: 937 time: 1.0649016
May 31 16:30:08.910352 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.v2.base [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Request body: {'port': {'device_id': '06a5ad82-8d5e-4b30-b2b7-b9549538ab75', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79381'}} {{(pid=91764) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:30:08.984651 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-62720a6b-e4cb-4fa5-af29-4d91bac88f3c tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:30:08.998935 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-f6595d25-ae65-4125-91a4-7a289fc71499 None None] Provisioning for port 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 completed by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:30:08.999477 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-62720a6b-e4cb-4fa5-af29-4d91bac88f3c tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Usage tracker for resource:port and tenant:be6bbbcf37dc490480d276accbb4a108 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:30:09.006632 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-62720a6b-e4cb-4fa5-af29-4d91bac88f3c tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:30:09.013086 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-62720a6b-e4cb-4fa5-af29-4d91bac88f3c tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:30:09.013284 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-f6595d25-ae65-4125-91a4-7a289fc71499 None None] Provisioning complete for port 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 triggered by entity DHCP. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:30:09.013934 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f6595d25-ae65-4125-91a4-7a289fc71499 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:09.022597 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-62720a6b-e4cb-4fa5-af29-4d91bac88f3c tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Made reservation on behalf of be6bbbcf37dc490480d276accbb4a108 for: {'port': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:30:09.026267 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-62720a6b-e4cb-4fa5-af29-4d91bac88f3c tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:09.056488 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:09.082209 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-f6595d25-ae65-4125-91a4-7a289fc71499 None None] Port 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 cannot update to ACTIVE because it is not bound. {{(pid=91765) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 31 16:30:09.185174 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:09.202945 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-62720a6b-e4cb-4fa5-af29-4d91bac88f3c tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Allocated IP 172.20.0.7 (9526c501-6f8f-4f53-8d14-c5917c4cfa9e/c3ef4bfd-26df-47c9-b849-a7ffdc14c690/bc64f0d6-a4ca-4f64-a5fc-38bd0631007c) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:30:09.301333 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d402f905-7a14-443d-9e84-13e0d631846e req-af59e017-a0db-4c41-b90e-8f661c273a59 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:09.302186 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-d402f905-7a14-443d-9e84-13e0d631846e req-af59e017-a0db-4c41-b90e-8f661c273a59 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Synchronizing usage tracker for tenant:50928f153a3147309c906abd6dba60d7 on resource:port {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:30:09.384438 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-d402f905-7a14-443d-9e84-13e0d631846e req-af59e017-a0db-4c41-b90e-8f661c273a59 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Unset dirty status for tenant:50928f153a3147309c906abd6dba60d7 on resource:port {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:30:09.385607 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d402f905-7a14-443d-9e84-13e0d631846e req-af59e017-a0db-4c41-b90e-8f661c273a59 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/ports?device_id=06a5ad82-8d5e-4b30-b2b7-b9549538ab75 HTTP/1.1" status: 200  len: 935 time: 0.2759311
May 31 16:30:09.414374 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-62720a6b-e4cb-4fa5-af29-4d91bac88f3c tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:09.444429 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-62720a6b-e4cb-4fa5-af29-4d91bac88f3c tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:09.449999 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-6bd386ed-d4b5-4e83-8af1-ba4038c09593 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:09.461867 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-d402f905-7a14-443d-9e84-13e0d631846e req-e4f30369-21b2-48e0-9c46-1d74144667bd tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Synchronizing usage tracker for tenant:50928f153a3147309c906abd6dba60d7 on resource:security_group {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:30:09.521195 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-62720a6b-e4cb-4fa5-af29-4d91bac88f3c tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Network 9526c501-6f8f-4f53-8d14-c5917c4cfa9e is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:30:09.522427 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-d402f905-7a14-443d-9e84-13e0d631846e req-e4f30369-21b2-48e0-9c46-1d74144667bd tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Unset dirty status for tenant:50928f153a3147309c906abd6dba60d7 on resource:security_group {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:30:09.523573 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d402f905-7a14-443d-9e84-13e0d631846e req-e4f30369-21b2-48e0-9c46-1d74144667bd tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4f00906-9032-43c7-9ede-5a8cb87efb07&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1230674
May 31 16:30:09.524472 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-62720a6b-e4cb-4fa5-af29-4d91bac88f3c tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:30:09.528526 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-62720a6b-e4cb-4fa5-af29-4d91bac88f3c tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:30:09.552220 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 {{(pid=91764) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:30:09.559921 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:09.564034 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62720a6b-e4cb-4fa5-af29-4d91bac88f3c tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Pushing event updated for resources: {'Port': ['ID=bc64f0d6-a4ca-4f64-a5fc-38bd0631007c,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:09.576728 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-62720a6b-e4cb-4fa5-af29-4d91bac88f3c tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:09.583588 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.provisioning_blocks [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Transition to ACTIVE for port object 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 will not be triggered until provisioned by entity L2. {{(pid=91764) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:30:09.587730 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:09.591532 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-72b6f8a2-1e7b-48b6-9aef-85e40e213d06 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:09.597489 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-62720a6b-e4cb-4fa5-af29-4d91bac88f3c tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:09.598159 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-62720a6b-e4cb-4fa5-af29-4d91bac88f3c tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:09.619073 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-62720a6b-e4cb-4fa5-af29-4d91bac88f3c tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.63 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.8029025
May 31 16:30:09.631707 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Request body: {'port': {'device_id': 'f7619b67-f2eb-4db8-8554-87b1e555294e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79381'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:30:09.750175 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:09.753227 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Pushing event updated for resources: {'Port': ['ID=1f5ab677-aa60-4175-a0b1-db3a8d80bdb7,revision_number=2']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:09.758692 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:09.944774 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Attempting to bind port 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 on host hv-cinder-79381 for vnic_type normal with profile  {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:30:09.945478 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Attempting to bind port 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 by drivers openvswitch,hyperv on host hv-cinder-79381 at level 0 using segments [{'id': 'a40252b3-1b75-4d21-8156-a52375347d5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 810, 'network_id': '212ab211-7c76-4934-acfc-01c978c3aca3'}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:30:09.945478 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Attempting to bind port 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 on network 212ab211-7c76-4934-acfc-01c978c3aca3 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:30:09.950206 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Port 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 on network 212ab211-7c76-4934-acfc-01c978c3aca3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79381 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 31 16:30:09.950524 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Attempting to bind port 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 on network 212ab211-7c76-4934-acfc-01c978c3aca3 {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:30:09.957686 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Checking agent: {'id': '4bed2638-4d91-4afb-bf81-aacca8584621', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79381', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'started_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 29, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:30:09.957962 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Checking segment: {'id': 'a40252b3-1b75-4d21-8156-a52375347d5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 810, 'network_id': '212ab211-7c76-4934-acfc-01c978c3aca3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91764) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:30:09.958549 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Bound using segment: {'id': 'a40252b3-1b75-4d21-8156-a52375347d5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 810, 'network_id': '212ab211-7c76-4934-acfc-01c978c3aca3'} {{(pid=91764) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:30:09.958990 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.managers [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Bound port: 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7, host: hv-cinder-79381, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a40252b3-1b75-4d21-8156-a52375347d5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 810, 'network_id': '212ab211-7c76-4934-acfc-01c978c3aca3'}}] {{(pid=91764) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:30:09.959343 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:10.110509 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] For port 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7, host hv-cinder-79381, cleared binding levels {{(pid=91764) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:30:10.116221 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] For port 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7, host hv-cinder-79381, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=1f5ab677-aa60-4175-a0b1-db3a8d80bdb7,segment=NetworkSegment(a40252b3-1b75-4d21-8156-a52375347d5c),segment_id=a40252b3-1b75-4d21-8156-a52375347d5c)] {{(pid=91764) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:30:10.123201 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14905816'] for port, after_update {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:10.128194 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-bade9c32-9329-4789-a86b-5b57d61c2a44 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:10.132374 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bc64f0d6-a4ca-4f64-a5fc-38bd0631007c {{(pid=91763) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:30:10.140276 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:10.156582 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.provisioning_blocks [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Transition to ACTIVE for port object bc64f0d6-a4ca-4f64-a5fc-38bd0631007c will not be triggered until provisioned by entity L2. {{(pid=91763) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:30:10.162056 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14337082'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:10.167079 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-91209284-b9b8-4a8e-9235-5f6856769b10 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:10.187633 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381e9635-b976-43fb-ae17-d1e20453bbc8 req-e2291c8d-6471-4340-a415-5895bbbe3fcf tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:10.189125 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-381e9635-b976-43fb-ae17-d1e20453bbc8 req-e2291c8d-6471-4340-a415-5895bbbe3fcf tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=f7619b67-f2eb-4db8-8554-87b1e555294e HTTP/1.1" status: 200  len: 931 time: 0.1862645
May 31 16:30:10.202322 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:10.203287 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:10.204386 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] 10.222.0.63 "PUT /v2.0/ports/1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 HTTP/1.1" status: 200  len: 1097 time: 1.2985244
May 31 16:30:10.211100 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '06a5ad82-8d5e-4b30-b2b7-b9549538ab75', 'tag': '1f5ab677-aa60-4175-a0b1-db3a8d80bdb7'}] {{(pid=91764) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:30:10.213487 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebd90bf98c9127bee7fd3a0341eeb33409332a1b2a5ae0ce9ae3c16b580cb127" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-105265ef-0021-4d7e-a32a-51588955fadc" -d '{"events": [{"name": "network-changed", "server_uuid": "06a5ad82-8d5e-4b30-b2b7-b9549538ab75", "tag": "1f5ab677-aa60-4175-a0b1-db3a8d80bdb7"}]}' {{(pid=91764) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:30:10.299155 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:30:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4b69cab2-51f4-4195-9981-d7c2184afb63 x-openstack-request-id: req-4b69cab2-51f4-4195-9981-d7c2184afb63 {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:30:10.299676 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "06a5ad82-8d5e-4b30-b2b7-b9549538ab75", "tag": "1f5ab677-aa60-4175-a0b1-db3a8d80bdb7", "status": "completed", "code": 200}]} {{(pid=91764) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:30:10.300145 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-4b69cab2-51f4-4195-9981-d7c2184afb63 {{(pid=91764) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:30:10.301771 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '06a5ad82-8d5e-4b30-b2b7-b9549538ab75', 'tag': '1f5ab677-aa60-4175-a0b1-db3a8d80bdb7', 'status': 'completed', 'code': 200}
May 31 16:30:10.325161 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Pushing event updated for resources: {'Port': ['ID=1f5ab677-aa60-4175-a0b1-db3a8d80bdb7,revision_number=3']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:10.346054 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-1eb4be00-b44a-42eb-aeb6-d8afb11f1762 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.218s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:10.369465 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-381e9635-b976-43fb-ae17-d1e20453bbc8 req-9ff06916-2d85-495a-904d-ee198230bdd9 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Synchronizing usage tracker for tenant:be6bbbcf37dc490480d276accbb4a108 on resource:security_group {{(pid=91764) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:30:10.398173 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [req-381e9635-b976-43fb-ae17-d1e20453bbc8 req-9ff06916-2d85-495a-904d-ee198230bdd9 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Unset dirty status for tenant:be6bbbcf37dc490480d276accbb4a108 on resource:security_group {{(pid=91764) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:30:10.399412 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-381e9635-b976-43fb-ae17-d1e20453bbc8 req-9ff06916-2d85-495a-904d-ee198230bdd9 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/security-groups?id=0cc7c395-a53f-46a5-877c-c098be2d3279&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1894956
May 31 16:30:10.407324 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-7cc27abb-b760-4a79-9aba-8a480123bdc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:10.408792 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-7cc27abb-b760-4a79-9aba-8a480123bdc3 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=50928f153a3147309c906abd6dba60d7&device_id=06a5ad82-8d5e-4b30-b2b7-b9549538ab75 HTTP/1.1" status: 200  len: 1100 time: 0.1602612
May 31 16:30:10.437127 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Pushing event updated for resources: {'Port': ['ID=bc64f0d6-a4ca-4f64-a5fc-38bd0631007c,revision_number=2']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:10.445170 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.278s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:10.482719 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-5d9ec861-ad13-401e-8d72-83ffb94917c1 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.13&port_id=1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 HTTP/1.1" status: 200  len: 217 time: 0.0655556
May 31 16:30:10.521194 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Attempting to bind port bc64f0d6-a4ca-4f64-a5fc-38bd0631007c on host hv-cinder-79381 for vnic_type normal with profile  {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:30:10.521491 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Attempting to bind port bc64f0d6-a4ca-4f64-a5fc-38bd0631007c by drivers openvswitch,hyperv on host hv-cinder-79381 at level 0 using segments [{'id': 'a23fa11b-36ad-446f-bbcc-5f71f4a7c045', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 847, 'network_id': '9526c501-6f8f-4f53-8d14-c5917c4cfa9e'}] {{(pid=91763) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:30:10.521847 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Attempting to bind port bc64f0d6-a4ca-4f64-a5fc-38bd0631007c on network 9526c501-6f8f-4f53-8d14-c5917c4cfa9e {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:30:10.526693 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Port bc64f0d6-a4ca-4f64-a5fc-38bd0631007c on network 9526c501-6f8f-4f53-8d14-c5917c4cfa9e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79381 {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 31 16:30:10.527015 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Attempting to bind port bc64f0d6-a4ca-4f64-a5fc-38bd0631007c on network 9526c501-6f8f-4f53-8d14-c5917c4cfa9e {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:30:10.532104 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Checking agent: {'id': '4bed2638-4d91-4afb-bf81-aacca8584621', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79381', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'started_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 29, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:30:10.532432 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Checking segment: {'id': 'a23fa11b-36ad-446f-bbcc-5f71f4a7c045', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 847, 'network_id': '9526c501-6f8f-4f53-8d14-c5917c4cfa9e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91763) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:30:10.532808 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Bound using segment: {'id': 'a23fa11b-36ad-446f-bbcc-5f71f4a7c045', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 847, 'network_id': '9526c501-6f8f-4f53-8d14-c5917c4cfa9e'} {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:30:10.533225 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Bound port: bc64f0d6-a4ca-4f64-a5fc-38bd0631007c, host: hv-cinder-79381, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a23fa11b-36ad-446f-bbcc-5f71f4a7c045', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 847, 'network_id': '9526c501-6f8f-4f53-8d14-c5917c4cfa9e'}}] {{(pid=91763) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:30:10.533593 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:10.550900 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-67b4d1ef-3f11-4a42-a34d-d41fadf8f4f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:10.550900 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-67b4d1ef-3f11-4a42-a34d-d41fadf8f4f1 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=47a67de8-eac8-4eef-b09c-ca63cc33d90c HTTP/1.1" status: 200  len: 843 time: 0.0608392
May 31 16:30:10.634619 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-6ac4d1e3-978c-40b8-9821-94326391b399 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:10.636530 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-6ac4d1e3-978c-40b8-9821-94326391b399 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=212ab211-7c76-4934-acfc-01c978c3aca3&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.0788059
May 31 16:30:10.640245 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] For port bc64f0d6-a4ca-4f64-a5fc-38bd0631007c, host hv-cinder-79381, cleared binding levels {{(pid=91763) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:30:10.643346 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] For port bc64f0d6-a4ca-4f64-a5fc-38bd0631007c, host hv-cinder-79381, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=bc64f0d6-a4ca-4f64-a5fc-38bd0631007c,segment=NetworkSegment(a23fa11b-36ad-446f-bbcc-5f71f4a7c045),segment_id=a23fa11b-36ad-446f-bbcc-5f71f4a7c045)] {{(pid=91763) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:30:10.648618 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14337082'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:10.652360 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-612acdc4-c4e5-4ff1-8f78-d1eedbe68311 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:10.713557 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:10.714105 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:10.715482 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] 10.222.0.63 "PUT /v2.0/ports/bc64f0d6-a4ca-4f64-a5fc-38bd0631007c HTTP/1.1" status: 200  len: 1093 time: 1.0887144
May 31 16:30:10.715998 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f7619b67-f2eb-4db8-8554-87b1e555294e', 'tag': 'bc64f0d6-a4ca-4f64-a5fc-38bd0631007c'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:30:10.718290 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-082a1ca3-f2dc-4525-9e43-f810e6bab6b1" -d '{"events": [{"name": "network-changed", "server_uuid": "f7619b67-f2eb-4db8-8554-87b1e555294e", "tag": "bc64f0d6-a4ca-4f64-a5fc-38bd0631007c"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:30:10.744139 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Pushing event updated for resources: {'Port': ['ID=bc64f0d6-a4ca-4f64-a5fc-38bd0631007c,revision_number=3']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:10.750213 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-950928ed-7cee-44b6-8013-9b687782c1a3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:10.793952 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:30:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2449b3fc-c784-4d50-826a-7e87ee176d8a x-openstack-request-id: req-2449b3fc-c784-4d50-826a-7e87ee176d8a {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:30:10.794287 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f7619b67-f2eb-4db8-8554-87b1e555294e", "tag": "bc64f0d6-a4ca-4f64-a5fc-38bd0631007c", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:30:10.794582 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-2449b3fc-c784-4d50-826a-7e87ee176d8a {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:30:10.795008 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f7619b67-f2eb-4db8-8554-87b1e555294e', 'tag': 'bc64f0d6-a4ca-4f64-a5fc-38bd0631007c', 'status': 'completed', 'code': 200}
May 31 16:30:10.836651 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-0010a38d-cec4-4745-a0f3-08f387596e0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:10.838149 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-0010a38d-cec4-4745-a0f3-08f387596e0f service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=be6bbbcf37dc490480d276accbb4a108&device_id=f7619b67-f2eb-4db8-8554-87b1e555294e HTTP/1.1" status: 200  len: 1096 time: 0.0809233
May 31 16:30:10.842256 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99cd235c-aa51-4786-97f7-3bb9812bd7a1 req-61fa9d5e-5cf5-4544-9617-1576e6e6962d tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:10.843684 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-99cd235c-aa51-4786-97f7-3bb9812bd7a1 req-61fa9d5e-5cf5-4544-9617-1576e6e6962d tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/ports?device_id=06a5ad82-8d5e-4b30-b2b7-b9549538ab75 HTTP/1.1" status: 200  len: 947 time: 0.2061174
May 31 16:30:10.847027 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-2e5ad448-5ede-4a3d-87c5-d9efa6464f48 service neutron] 10.222.0.63 "GET /v2.0/networks/212ab211-7c76-4934-acfc-01c978c3aca3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1722891
May 31 16:30:10.894528 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:10.912200 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-8f5879fd-488c-4c4f-8e8a-057d5765bbe3 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=bc64f0d6-a4ca-4f64-a5fc-38bd0631007c HTTP/1.1" status: 200  len: 217 time: 0.0655215
May 31 16:30:10.974491 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-99cd235c-aa51-4786-97f7-3bb9812bd7a1 req-58fa2a13-bac0-4a25-b9ed-243f49c082fd tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4f00906-9032-43c7-9ede-5a8cb87efb07&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1239359
May 31 16:30:10.981562 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-a21be55f-42f7-4962-b4dc-87af61f96ae7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:10.986991 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-a21be55f-42f7-4962-b4dc-87af61f96ae7 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=c3ef4bfd-26df-47c9-b849-a7ffdc14c690 HTTP/1.1" status: 200  len: 848 time: 0.0643342
May 31 16:30:11.012687 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-205d383f-c04a-45a6-9ff8-832b4a78ae10 req-30e0e145-fa0b-475d-997b-a5d9288e29a3 service neutron] 10.222.0.63 "GET /v2.0/networks/212ab211-7c76-4934-acfc-01c978c3aca3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1494884
May 31 16:30:11.033626 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-08d784e0-8651-46f1-b152-ff5077309801 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=9526c501-6f8f-4f53-8d14-c5917c4cfa9e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0419281
May 31 16:30:11.146804 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-105265ef-0021-4d7e-a32a-51588955fadc req-4d920438-3d2f-40e4-ad9e-887dc756d915 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:11.148265 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-105265ef-0021-4d7e-a32a-51588955fadc req-4d920438-3d2f-40e4-ad9e-887dc756d915 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=50928f153a3147309c906abd6dba60d7&device_id=06a5ad82-8d5e-4b30-b2b7-b9549538ab75 HTTP/1.1" status: 200  len: 1100 time: 0.0791790
May 31 16:30:11.179848 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-ff4a6824-4f9c-45c5-bc8a-a4b47ad53615 service neutron] 10.222.0.63 "GET /v2.0/networks/9526c501-6f8f-4f53-8d14-c5917c4cfa9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1283941
May 31 16:30:11.281854 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-105265ef-0021-4d7e-a32a-51588955fadc req-1fe448cf-f8e8-458c-951c-35802fffd596 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:11.283254 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-105265ef-0021-4d7e-a32a-51588955fadc req-1fe448cf-f8e8-458c-951c-35802fffd596 service neutron] 10.222.0.63 "GET /v2.0/networks?id=212ab211-7c76-4934-acfc-01c978c3aca3 HTTP/1.1" status: 200  len: 870 time: 0.1277747
May 31 16:30:11.313396 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7fa934c8-413a-4788-a2dd-63e386ea7420 req-f5b14779-e2c6-4937-8c95-9aee752cf8f2 service neutron] 10.222.0.63 "GET /v2.0/networks/9526c501-6f8f-4f53-8d14-c5917c4cfa9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1263685
May 31 16:30:11.355437 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-105265ef-0021-4d7e-a32a-51588955fadc req-400d93e2-c582-44de-85cf-f8a6c4709b22 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.13&port_id=1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 HTTP/1.1" status: 200  len: 217 time: 0.0650485
May 31 16:30:11.426738 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-105265ef-0021-4d7e-a32a-51588955fadc req-1671445c-f2de-4a14-99ab-6e3612553415 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:11.428241 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-105265ef-0021-4d7e-a32a-51588955fadc req-1671445c-f2de-4a14-99ab-6e3612553415 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=47a67de8-eac8-4eef-b09c-ca63cc33d90c HTTP/1.1" status: 200  len: 843 time: 0.0592904
May 31 16:30:11.447975 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082a1ca3-f2dc-4525-9e43-f810e6bab6b1 req-a4f53082-a2e6-4f67-a1f9-79489abdaa8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:11.449540 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-082a1ca3-f2dc-4525-9e43-f810e6bab6b1 req-a4f53082-a2e6-4f67-a1f9-79489abdaa8b service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=be6bbbcf37dc490480d276accbb4a108&device_id=f7619b67-f2eb-4db8-8554-87b1e555294e HTTP/1.1" status: 200  len: 1096 time: 0.0800254
May 31 16:30:11.510521 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-105265ef-0021-4d7e-a32a-51588955fadc req-82f46ee0-6f8f-4736-9a10-e1a12827fa7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:11.512000 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-105265ef-0021-4d7e-a32a-51588955fadc req-82f46ee0-6f8f-4736-9a10-e1a12827fa7a service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=212ab211-7c76-4934-acfc-01c978c3aca3&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.0741675
May 31 16:30:11.524784 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [req-105265ef-0021-4d7e-a32a-51588955fadc req-bf1a5899-9423-48e7-9f41-20cb01701edf service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=91764) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 31 16:30:11.525737 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-105265ef-0021-4d7e-a32a-51588955fadc req-bf1a5899-9423-48e7-9f41-20cb01701edf service neutron] 10.222.0.63 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0050018
May 31 16:30:11.593063 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082a1ca3-f2dc-4525-9e43-f810e6bab6b1 req-fa350c27-4021-4db1-ace8-fe997e7ebadc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:11.594574 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-082a1ca3-f2dc-4525-9e43-f810e6bab6b1 req-fa350c27-4021-4db1-ace8-fe997e7ebadc service neutron] 10.222.0.63 "GET /v2.0/networks?id=9526c501-6f8f-4f53-8d14-c5917c4cfa9e HTTP/1.1" status: 200  len: 909 time: 0.1382167
May 31 16:30:11.665753 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-082a1ca3-f2dc-4525-9e43-f810e6bab6b1 req-3fee9ebc-197b-4d30-8712-9b35e4a76cb8 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=bc64f0d6-a4ca-4f64-a5fc-38bd0631007c HTTP/1.1" status: 200  len: 217 time: 0.0616984
May 31 16:30:11.736863 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082a1ca3-f2dc-4525-9e43-f810e6bab6b1 req-16d7e616-ca33-4b84-8501-8d0de531a303 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:11.739091 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-082a1ca3-f2dc-4525-9e43-f810e6bab6b1 req-16d7e616-ca33-4b84-8501-8d0de531a303 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=c3ef4bfd-26df-47c9-b849-a7ffdc14c690 HTTP/1.1" status: 200  len: 848 time: 0.0641041
May 31 16:30:11.791473 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-082a1ca3-f2dc-4525-9e43-f810e6bab6b1 req-d25384bb-62a9-4aed-aab9-19ce1fb5a35b service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=9526c501-6f8f-4f53-8d14-c5917c4cfa9e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0429056
May 31 16:30:11.831096 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-105265ef-0021-4d7e-a32a-51588955fadc req-e8428868-1ae8-41cb-8e17-f1552b4a8bec service neutron] 10.222.0.63 "GET /v2.0/networks/212ab211-7c76-4934-acfc-01c978c3aca3?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2658079
May 31 16:30:11.838965 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53c65507-9394-41b3-8f6e-a2114a8a6738 req-79182679-6e0d-49d0-9e6b-f1446fe5a2b8 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:11.840319 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-53c65507-9394-41b3-8f6e-a2114a8a6738 req-79182679-6e0d-49d0-9e6b-f1446fe5a2b8 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=f7619b67-f2eb-4db8-8554-87b1e555294e HTTP/1.1" status: 200  len: 943 time: 0.3137770
May 31 16:30:11.926677 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-082a1ca3-f2dc-4525-9e43-f810e6bab6b1 req-c8ca1eb5-17be-4833-95ed-d9651b7471fa service neutron] 10.222.0.63 "GET /v2.0/networks/9526c501-6f8f-4f53-8d14-c5917c4cfa9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1265123
May 31 16:30:11.965813 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-53c65507-9394-41b3-8f6e-a2114a8a6738 req-1d39984c-085d-452b-aac0-05134efcfcf8 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/security-groups?id=0cc7c395-a53f-46a5-877c-c098be2d3279&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1063724
May 31 16:30:12.008990 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-105265ef-0021-4d7e-a32a-51588955fadc req-51296362-7bc1-4ee4-8431-097026547346 service neutron] 10.222.0.63 "GET /v2.0/networks/212ab211-7c76-4934-acfc-01c978c3aca3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1669393
May 31 16:30:12.168015 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-082a1ca3-f2dc-4525-9e43-f810e6bab6b1 req-07e3ad76-16fe-413b-afb7-15d5b283e09e service neutron] 10.222.0.63 "GET /v2.0/networks/9526c501-6f8f-4f53-8d14-c5917c4cfa9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2338521
May 31 16:30:12.168582 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a22be0cb-e8a8-44c7-bc64-aea3eb2b1788 req-82da726b-2602-4517-9d17-2f3b078f13d7 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:12.170061 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a22be0cb-e8a8-44c7-bc64-aea3eb2b1788 req-82da726b-2602-4517-9d17-2f3b078f13d7 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/ports?device_id=06a5ad82-8d5e-4b30-b2b7-b9549538ab75 HTTP/1.1" status: 200  len: 947 time: 0.0819385
May 31 16:30:12.220214 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a22be0cb-e8a8-44c7-bc64-aea3eb2b1788 req-8562bf85-845a-4c6a-9bde-d6e9f108c9ca tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4f00906-9032-43c7-9ede-5a8cb87efb07&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0443678
May 31 16:30:12.546359 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:30:12.678269 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=1f5ab677-aa60-4175-a0b1-db3a8d80bdb7,segment=NetworkSegment(a40252b3-1b75-4d21-8156-a52375347d5c),segment_id=a40252b3-1b75-4d21-8156-a52375347d5c)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:30:12.692075 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': '1f5ab677-aa60-4175-a0b1-db3a8d80bdb7', 'network_id': '212ab211-7c76-4934-acfc-01c978c3aca3', 'port_id': '1f5ab677-aa60-4175-a0b1-db3a8d80bdb7', 'mac_address': 'fa:16:3e:cc:c2:7c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 810, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '47a67de8-eac8-4eef-b09c-ca63cc33d90c', 'ip_address': '192.168.233.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:30:12.749846 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:12.767086 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:30:12.782165 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=1f5ab677-aa60-4175-a0b1-db3a8d80bdb7,segment=NetworkSegment(a40252b3-1b75-4d21-8156-a52375347d5c),segment_id=a40252b3-1b75-4d21-8156-a52375347d5c)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:30:12.786865 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:12.787756 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device bc64f0d6-a4ca-4f64-a5fc-38bd0631007c details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:30:12.789985 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-7ba16518-7199-40e2-a47c-0c6015bf3b18 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:12.950327 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=1f5ab677-aa60-4175-a0b1-db3a8d80bdb7,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:12.957535 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:13.013824 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port bc64f0d6-a4ca-4f64-a5fc-38bd0631007c, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=bc64f0d6-a4ca-4f64-a5fc-38bd0631007c,segment=NetworkSegment(a23fa11b-36ad-446f-bbcc-5f71f4a7c045),segment_id=a23fa11b-36ad-446f-bbcc-5f71f4a7c045)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:30:13.028510 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': 'bc64f0d6-a4ca-4f64-a5fc-38bd0631007c', 'network_id': '9526c501-6f8f-4f53-8d14-c5917c4cfa9e', 'port_id': 'bc64f0d6-a4ca-4f64-a5fc-38bd0631007c', 'mac_address': 'fa:16:3e:b3:dc:8f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 847, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c3ef4bfd-26df-47c9-b849-a7ffdc14c690', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:30:13.086082 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:13.103819 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bc64f0d6-a4ca-4f64-a5fc-38bd0631007c {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:30:13.121409 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port bc64f0d6-a4ca-4f64-a5fc-38bd0631007c, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=bc64f0d6-a4ca-4f64-a5fc-38bd0631007c,segment=NetworkSegment(a23fa11b-36ad-446f-bbcc-5f71f4a7c045),segment_id=a23fa11b-36ad-446f-bbcc-5f71f4a7c045)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:30:13.125468 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:13.128380 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:13.155430 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af1b3aef-b693-47d5-93bb-ba6fa4caf31a req-d83d3c1c-e071-432a-a837-6ecfb933c2bb tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:13.156866 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-af1b3aef-b693-47d5-93bb-ba6fa4caf31a req-d83d3c1c-e071-432a-a837-6ecfb933c2bb tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=f7619b67-f2eb-4db8-8554-87b1e555294e HTTP/1.1" status: 200  len: 943 time: 0.0835884
May 31 16:30:13.194755 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=bc64f0d6-a4ca-4f64-a5fc-38bd0631007c,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:13.197909 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:13.204462 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-af1b3aef-b693-47d5-93bb-ba6fa4caf31a req-19104fbd-1fc5-4eeb-b408-c6735bf5152f tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/security-groups?id=0cc7c395-a53f-46a5-877c-c098be2d3279&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409620
May 31 16:30:13.364800 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['1f5ab677-aa60-4175-a0b1-db3a8d80bdb7'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:30:13.398665 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['bc64f0d6-a4ca-4f64-a5fc-38bd0631007c'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:30:13.411110 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8167e9b-cea2-499a-8038-37d9021beb93 req-b3a7e9c9-ddd6-4fce-930d-bbeb33a541b4 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:13.412586 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d8167e9b-cea2-499a-8038-37d9021beb93 req-b3a7e9c9-ddd6-4fce-930d-bbeb33a541b4 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/ports?device_id=06a5ad82-8d5e-4b30-b2b7-b9549538ab75 HTTP/1.1" status: 200  len: 948 time: 0.0866654
May 31 16:30:13.470791 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-d8167e9b-cea2-499a-8038-37d9021beb93 req-8178a87d-da1f-4781-b033-cc416659fc4f tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4f00906-9032-43c7-9ede-5a8cb87efb07&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0457239
May 31 16:30:14.394873 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcb597ac-b250-4248-93a5-ad0ccc8221ce req-0f95e704-5c7f-4a83-adfb-44e9a657ae37 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:14.396321 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bcb597ac-b250-4248-93a5-ad0ccc8221ce req-0f95e704-5c7f-4a83-adfb-44e9a657ae37 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=f7619b67-f2eb-4db8-8554-87b1e555294e HTTP/1.1" status: 200  len: 944 time: 0.0812490
May 31 16:30:14.441438 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bcb597ac-b250-4248-93a5-ad0ccc8221ce req-eae76c04-9039-413d-8d43-2053c11f71ab tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/security-groups?id=0cc7c395-a53f-46a5-877c-c098be2d3279&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0393741
May 31 16:30:14.568618 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:30:14.640063 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning for port 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:30:14.644718 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:30:14.645146 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:14.662663 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9305f463-8dcb-459b-a510-e9d281004a75 req-720efd76-fe82-4e3f-ba14-8a158b11b09e tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:14.664150 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9305f463-8dcb-459b-a510-e9d281004a75 req-720efd76-fe82-4e3f-ba14-8a158b11b09e tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/ports?device_id=06a5ad82-8d5e-4b30-b2b7-b9549538ab75 HTTP/1.1" status: 200  len: 948 time: 0.0864940
May 31 16:30:14.710389 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9305f463-8dcb-459b-a510-e9d281004a75 req-43508c72-1bae-4cb2-ae43-3e2d9b817446 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4f00906-9032-43c7-9ede-5a8cb87efb07&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0402308
May 31 16:30:14.759066 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:14.788159 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '06a5ad82-8d5e-4b30-b2b7-b9549538ab75', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f5ab677-aa60-4175-a0b1-db3a8d80bdb7'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:30:14.790437 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b64d6d9f-d2a9-417c-afb7-418553c56afd" -d '{"events": [{"server_uuid": "06a5ad82-8d5e-4b30-b2b7-b9549538ab75", "name": "network-vif-plugged", "status": "completed", "tag": "1f5ab677-aa60-4175-a0b1-db3a8d80bdb7"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:30:14.798398 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=1f5ab677-aa60-4175-a0b1-db3a8d80bdb7,segment=NetworkSegment(a40252b3-1b75-4d21-8156-a52375347d5c),segment_id=a40252b3-1b75-4d21-8156-a52375347d5c)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:30:14.803260 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:14.804123 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device bc64f0d6-a4ca-4f64-a5fc-38bd0631007c up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:30:14.833202 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-ecec7317-bd80-4362-95a4-9e7125416f1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:14.872671 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:30:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1aaf7414-f33c-4028-847d-73cb7bac9f44 x-openstack-request-id: req-1aaf7414-f33c-4028-847d-73cb7bac9f44 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:30:14.872951 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "06a5ad82-8d5e-4b30-b2b7-b9549538ab75", "name": "network-vif-plugged", "status": "completed", "tag": "1f5ab677-aa60-4175-a0b1-db3a8d80bdb7", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:30:14.873219 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-1aaf7414-f33c-4028-847d-73cb7bac9f44 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:30:14.873638 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '06a5ad82-8d5e-4b30-b2b7-b9549538ab75', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f5ab677-aa60-4175-a0b1-db3a8d80bdb7', 'code': 200}
May 31 16:30:14.924241 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=1f5ab677-aa60-4175-a0b1-db3a8d80bdb7,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:14.927979 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:14.936449 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning for port bc64f0d6-a4ca-4f64-a5fc-38bd0631007c completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:30:14.941636 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port bc64f0d6-a4ca-4f64-a5fc-38bd0631007c triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:30:14.942020 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:15.063642 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:15.096024 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port bc64f0d6-a4ca-4f64-a5fc-38bd0631007c, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=bc64f0d6-a4ca-4f64-a5fc-38bd0631007c,segment=NetworkSegment(a23fa11b-36ad-446f-bbcc-5f71f4a7c045),segment_id=a23fa11b-36ad-446f-bbcc-5f71f4a7c045)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:30:15.101101 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:15.103744 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:15.110650 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63b60661-47ef-4a4c-827c-cde76404a7ec req-201379f1-293e-41cf-9dda-23729f2a8ef8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:15.112109 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-63b60661-47ef-4a4c-827c-cde76404a7ec req-201379f1-293e-41cf-9dda-23729f2a8ef8 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=06a5ad82-8d5e-4b30-b2b7-b9549538ab75 HTTP/1.1" status: 200  len: 1102 time: 0.1191795
May 31 16:30:15.159112 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-63b60661-47ef-4a4c-827c-cde76404a7ec req-324f80d3-ad7f-428c-98c8-4c018a609a29 service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=b4f00906-9032-43c7-9ede-5a8cb87efb07&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0390203
May 31 16:30:15.173130 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=bc64f0d6-a4ca-4f64-a5fc-38bd0631007c,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:15.176423 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:15.623712 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfe7eea4-b7cc-4cf2-a04f-9f7361a4a0b8 req-55d3b8db-f891-4b62-893c-da7d030d9255 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:15.625195 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cfe7eea4-b7cc-4cf2-a04f-9f7361a4a0b8 req-55d3b8db-f891-4b62-893c-da7d030d9255 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=f7619b67-f2eb-4db8-8554-87b1e555294e HTTP/1.1" status: 200  len: 945 time: 0.0802739
May 31 16:30:15.674774 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-cfe7eea4-b7cc-4cf2-a04f-9f7361a4a0b8 req-5bce8130-b739-443f-8060-eab297e69d21 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/security-groups?id=0cc7c395-a53f-46a5-877c-c098be2d3279&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0426133
May 31 16:30:15.900786 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1cb8973-93f2-4de9-8c7c-473ed7af3109 req-c7087200-e313-402b-8c4d-982e137b4e2f tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:15.902298 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c1cb8973-93f2-4de9-8c7c-473ed7af3109 req-c7087200-e313-402b-8c4d-982e137b4e2f tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/ports?device_id=06a5ad82-8d5e-4b30-b2b7-b9549538ab75 HTTP/1.1" status: 200  len: 949 time: 0.0842521
May 31 16:30:15.951921 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c1cb8973-93f2-4de9-8c7c-473ed7af3109 req-4c2e9748-e7a6-472a-9801-95e705b69fbf tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4f00906-9032-43c7-9ede-5a8cb87efb07&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438683
May 31 16:30:16.874687 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f7619b67-f2eb-4db8-8554-87b1e555294e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bc64f0d6-a4ca-4f64-a5fc-38bd0631007c'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:30:16.876999 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a5077a49-daa6-4e1e-b344-0a92aee7b95b" -d '{"events": [{"server_uuid": "f7619b67-f2eb-4db8-8554-87b1e555294e", "name": "network-vif-plugged", "status": "completed", "tag": "bc64f0d6-a4ca-4f64-a5fc-38bd0631007c"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:30:16.880354 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d6db54e-9a4e-473b-b225-65aefe0223ab req-7018f258-2da4-4d7b-b881-1243f984e3f6 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:16.881905 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1d6db54e-9a4e-473b-b225-65aefe0223ab req-7018f258-2da4-4d7b-b881-1243f984e3f6 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=f7619b67-f2eb-4db8-8554-87b1e555294e HTTP/1.1" status: 200  len: 945 time: 0.0882890
May 31 16:30:16.921145 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:30:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-587138f9-4855-430d-9321-c3255d62da2a x-openstack-request-id: req-587138f9-4855-430d-9321-c3255d62da2a {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:30:16.921451 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f7619b67-f2eb-4db8-8554-87b1e555294e", "name": "network-vif-plugged", "status": "completed", "tag": "bc64f0d6-a4ca-4f64-a5fc-38bd0631007c", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:30:16.921749 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-587138f9-4855-430d-9321-c3255d62da2a {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:30:16.922792 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f7619b67-f2eb-4db8-8554-87b1e555294e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bc64f0d6-a4ca-4f64-a5fc-38bd0631007c', 'code': 200}
May 31 16:30:16.930255 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1d6db54e-9a4e-473b-b225-65aefe0223ab req-863f3fd2-3c8b-429c-a767-2da1d58cd34c tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/security-groups?id=0cc7c395-a53f-46a5-877c-c098be2d3279&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0424123
May 31 16:30:17.149113 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-676d257d-a083-434e-afb8-58e60d5199f9 req-24002e99-f29c-4280-a38a-8a819f72805d tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:17.150646 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-676d257d-a083-434e-afb8-58e60d5199f9 req-24002e99-f29c-4280-a38a-8a819f72805d tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/ports?device_id=06a5ad82-8d5e-4b30-b2b7-b9549538ab75 HTTP/1.1" status: 200  len: 949 time: 0.0897400
May 31 16:30:17.162126 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4a68543-de8f-4520-b7ce-6d73087edc94 req-129454f6-e7c4-4dac-9c52-9ff7c763b6d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:17.163590 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-a4a68543-de8f-4520-b7ce-6d73087edc94 req-129454f6-e7c4-4dac-9c52-9ff7c763b6d3 service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=f7619b67-f2eb-4db8-8554-87b1e555294e HTTP/1.1" status: 200  len: 1098 time: 0.0836115
May 31 16:30:17.198032 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-676d257d-a083-434e-afb8-58e60d5199f9 req-1bf1defb-f681-4f0e-92eb-1704eb8279c8 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4f00906-9032-43c7-9ede-5a8cb87efb07&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413296
May 31 16:30:17.205874 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-a4a68543-de8f-4520-b7ce-6d73087edc94 req-d2355f89-eb3b-4eb3-b905-5d335f8e5209 service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=0cc7c395-a53f-46a5-877c-c098be2d3279&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0345833
May 31 16:30:17.657424 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca1e9c1-4e6b-4b7f-a0bf-b40f0813f6dc req-cbfb6379-66c5-4033-a18c-59f431973240 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:17.658936 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-aca1e9c1-4e6b-4b7f-a0bf-b40f0813f6dc req-cbfb6379-66c5-4033-a18c-59f431973240 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/ports?device_id=06a5ad82-8d5e-4b30-b2b7-b9549538ab75 HTTP/1.1" status: 200  len: 949 time: 0.0873718
May 31 16:30:17.709061 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-aca1e9c1-4e6b-4b7f-a0bf-b40f0813f6dc req-b2084434-0c58-4e57-b632-0d68259dc10f tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4f00906-9032-43c7-9ede-5a8cb87efb07&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0434694
May 31 16:30:18.145738 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b48e20c-2494-4fc3-91be-3f540cc0e477 req-fee3e2ef-3c3c-4ca9-bac3-b92ff8e516ef tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:18.147348 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7b48e20c-2494-4fc3-91be-3f540cc0e477 req-fee3e2ef-3c3c-4ca9-bac3-b92ff8e516ef tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=f7619b67-f2eb-4db8-8554-87b1e555294e HTTP/1.1" status: 200  len: 945 time: 0.0976841
May 31 16:30:18.193157 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7b48e20c-2494-4fc3-91be-3f540cc0e477 req-34212b0f-3196-405c-8438-888db8202d46 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/security-groups?id=0cc7c395-a53f-46a5-877c-c098be2d3279&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400839
May 31 16:30:18.902417 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9a90330-5926-4169-abf2-53aa74ddf974 req-d0560549-9ddd-4beb-9f31-cb0d9a595528 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:18.903870 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f9a90330-5926-4169-abf2-53aa74ddf974 req-d0560549-9ddd-4beb-9f31-cb0d9a595528 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/ports?device_id=06a5ad82-8d5e-4b30-b2b7-b9549538ab75 HTTP/1.1" status: 200  len: 949 time: 0.0887170
May 31 16:30:18.948460 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-f9a90330-5926-4169-abf2-53aa74ddf974 req-6105f41d-1add-41ba-b2ef-2a034dbabd7d tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4f00906-9032-43c7-9ede-5a8cb87efb07&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0389850
May 31 16:30:19.133618 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6289e22a-1a8b-4304-b746-ee40a5dfefc4 req-17fd7842-1260-4c86-aa77-dea5dcc4855e tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:19.135210 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-6289e22a-1a8b-4304-b746-ee40a5dfefc4 req-17fd7842-1260-4c86-aa77-dea5dcc4855e tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.63 "GET /v2.0/ports?device_id=06a5ad82-8d5e-4b30-b2b7-b9549538ab75 HTTP/1.1" status: 200  len: 949 time: 0.0851219
May 31 16:30:19.272610 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-6289e22a-1a8b-4304-b746-ee40a5dfefc4 req-d2bce476-b16f-49df-a98e-66b909aa8e42 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Deleting port 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:30:19.272876 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-6289e22a-1a8b-4304-b746-ee40a5dfefc4 req-d2bce476-b16f-49df-a98e-66b909aa8e42 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:19.379613 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e88a277-ca04-4cda-88ea-207de940d273 req-dad951f1-e835-4045-b70d-1dbfd8aa3baf tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:19.381270 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1e88a277-ca04-4cda-88ea-207de940d273 req-dad951f1-e835-4045-b70d-1dbfd8aa3baf tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=f7619b67-f2eb-4db8-8554-87b1e555294e HTTP/1.1" status: 200  len: 945 time: 0.0831919
May 31 16:30:19.411701 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-6289e22a-1a8b-4304-b746-ee40a5dfefc4 req-d2bce476-b16f-49df-a98e-66b909aa8e42 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] For port 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=1f5ab677-aa60-4175-a0b1-db3a8d80bdb7,segment=NetworkSegment(a40252b3-1b75-4d21-8156-a52375347d5c),segment_id=a40252b3-1b75-4d21-8156-a52375347d5c)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:30:19.412070 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-6289e22a-1a8b-4304-b746-ee40a5dfefc4 req-d2bce476-b16f-49df-a98e-66b909aa8e42 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:19.431180 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1e88a277-ca04-4cda-88ea-207de940d273 req-80186145-a08b-4c82-8312-81e8e095345f tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/security-groups?id=0cc7c395-a53f-46a5-877c-c098be2d3279&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0440564
May 31 16:30:19.542620 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-6289e22a-1a8b-4304-b746-ee40a5dfefc4 req-d2bce476-b16f-49df-a98e-66b909aa8e42 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Calling delete_port for 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 owned by compute:nova {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:30:19.653157 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-6289e22a-1a8b-4304-b746-ee40a5dfefc4 req-d2bce476-b16f-49df-a98e-66b909aa8e42 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:19.658945 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-a8a67643-8ed0-4da6-867d-e1201a14cbc1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:19.665443 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['1f5ab677-aa60-4175-a0b1-db3a8d80bdb7'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:30:19.712074 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2bce476-b16f-49df-a98e-66b909aa8e42 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Pushing event deleted for resources: {'Port': ['ID=1f5ab677-aa60-4175-a0b1-db3a8d80bdb7,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:19.717343 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:19.749035 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-d2bce476-b16f-49df-a98e-66b909aa8e42 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:19.793015 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [req-6289e22a-1a8b-4304-b746-ee40a5dfefc4 req-d2bce476-b16f-49df-a98e-66b909aa8e42 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] No DVR routers for this DVR port 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 on host hv-cinder-79381 {{(pid=91763) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:30:19.796115 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-6289e22a-1a8b-4304-b746-ee40a5dfefc4 req-d2bce476-b16f-49df-a98e-66b909aa8e42 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:19.801074 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '06a5ad82-8d5e-4b30-b2b7-b9549538ab75', 'name': 'network-vif-deleted', 'tag': '1f5ab677-aa60-4175-a0b1-db3a8d80bdb7'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:30:19.803602 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cd74cd1a-bef0-4271-837b-dbae240b6f8b" -d '{"events": [{"server_uuid": "06a5ad82-8d5e-4b30-b2b7-b9549538ab75", "name": "network-vif-deleted", "tag": "1f5ab677-aa60-4175-a0b1-db3a8d80bdb7"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:30:19.817294 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-6289e22a-1a8b-4304-b746-ee40a5dfefc4 req-d2bce476-b16f-49df-a98e-66b909aa8e42 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.63 "DELETE /v2.0/ports/1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 HTTP/1.1" status: 204  len: 173 time: 0.6759629
May 31 16:30:19.852075 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:30:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-af82a562-cfd2-42ca-b9f5-b95418184350 x-openstack-request-id: req-af82a562-cfd2-42ca-b9f5-b95418184350 {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:30:19.852538 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "06a5ad82-8d5e-4b30-b2b7-b9549538ab75", "name": "network-vif-deleted", "tag": "1f5ab677-aa60-4175-a0b1-db3a8d80bdb7", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:30:19.852934 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-af82a562-cfd2-42ca-b9f5-b95418184350 {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:30:19.853377 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '06a5ad82-8d5e-4b30-b2b7-b9549538ab75', 'name': 'network-vif-deleted', 'tag': '1f5ab677-aa60-4175-a0b1-db3a8d80bdb7', 'status': 'completed', 'code': 200}
May 31 16:30:20.113928 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-e60630d8-ce2c-48e0-b008-4445477a2c74 req-e2458e85-31fc-4647-b2ea-dcfc3b106e81 tempest-VolumesNegativeTest-1912720961 tempest-VolumesNegativeTest-1912720961-project] 10.222.0.43 "GET /v2.0/ports?device_id=06a5ad82-8d5e-4b30-b2b7-b9549538ab75 HTTP/1.1" status: 200  len: 210 time: 0.0425537
May 31 16:30:20.538100 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55615e25-626b-4f77-b828-8b3c8149b9ac req-88f63aaa-88c2-45ed-b4da-ca25bf6a0565 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:20.539630 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-55615e25-626b-4f77-b828-8b3c8149b9ac req-88f63aaa-88c2-45ed-b4da-ca25bf6a0565 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=f7619b67-f2eb-4db8-8554-87b1e555294e HTTP/1.1" status: 200  len: 945 time: 0.0940859
May 31 16:30:20.593270 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-55615e25-626b-4f77-b828-8b3c8149b9ac req-bad3a85b-33d2-4da1-8131-5252e6b87b36 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/security-groups?id=0cc7c395-a53f-46a5-877c-c098be2d3279&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0455325
May 31 16:30:21.802835 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-756dbe4d-fe89-4e3f-8a8f-06d55b692965 req-04e65bc8-4e38-4e25-81e7-8e4ab5ad5335 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:21.804307 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-756dbe4d-fe89-4e3f-8a8f-06d55b692965 req-04e65bc8-4e38-4e25-81e7-8e4ab5ad5335 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=f7619b67-f2eb-4db8-8554-87b1e555294e HTTP/1.1" status: 200  len: 945 time: 0.0982876
May 31 16:30:21.855614 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-756dbe4d-fe89-4e3f-8a8f-06d55b692965 req-a7cd4629-649b-4f50-874d-3c50370def99 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/security-groups?id=0cc7c395-a53f-46a5-877c-c098be2d3279&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0452564
May 31 16:30:21.934294 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ca3e643-a86b-4691-8fae-4260f673bce7 req-3739a103-5f04-46f6-a8c6-ea7e3b316a78 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:21.935206 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-5ca3e643-a86b-4691-8fae-4260f673bce7 req-3739a103-5f04-46f6-a8c6-ea7e3b316a78 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Synchronizing usage tracker for tenant:be6bbbcf37dc490480d276accbb4a108 on resource:port {{(pid=91763) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:30:21.956833 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-5ca3e643-a86b-4691-8fae-4260f673bce7 req-3739a103-5f04-46f6-a8c6-ea7e3b316a78 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Unset dirty status for tenant:be6bbbcf37dc490480d276accbb4a108 on resource:port {{(pid=91763) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:30:21.958005 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-5ca3e643-a86b-4691-8fae-4260f673bce7 req-3739a103-5f04-46f6-a8c6-ea7e3b316a78 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.63 "GET /v2.0/ports?device_id=f7619b67-f2eb-4db8-8554-87b1e555294e HTTP/1.1" status: 200  len: 945 time: 0.1207621
May 31 16:30:22.149904 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-5ca3e643-a86b-4691-8fae-4260f673bce7 req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Deleting port bc64f0d6-a4ca-4f64-a5fc-38bd0631007c {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:30:22.150252 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-5ca3e643-a86b-4691-8fae-4260f673bce7 req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:22.299718 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-5ca3e643-a86b-4691-8fae-4260f673bce7 req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] For port bc64f0d6-a4ca-4f64-a5fc-38bd0631007c, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=bc64f0d6-a4ca-4f64-a5fc-38bd0631007c,segment=NetworkSegment(a23fa11b-36ad-446f-bbcc-5f71f4a7c045),segment_id=a23fa11b-36ad-446f-bbcc-5f71f4a7c045)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:30:22.300633 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-5ca3e643-a86b-4691-8fae-4260f673bce7 req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:22.430910 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-5ca3e643-a86b-4691-8fae-4260f673bce7 req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Calling delete_port for bc64f0d6-a4ca-4f64-a5fc-38bd0631007c owned by compute:nova {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:30:22.551546 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-5ca3e643-a86b-4691-8fae-4260f673bce7 req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:22.557309 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-5e7359a9-d3b4-42c0-b5cf-1c644206230d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:22.564228 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['bc64f0d6-a4ca-4f64-a5fc-38bd0631007c'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:30:22.603782 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:30:22.644710 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] No Port match for: 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:30:22.645088 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device 1f5ab677-aa60-4175-a0b1-db3a8d80bdb7 not bound to the agent host hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:30:22.745486 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Pushing event deleted for resources: {'Port': ['ID=bc64f0d6-a4ca-4f64-a5fc-38bd0631007c,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:22.783023 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:22.783405 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:22.783777 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:22.784148 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:22.785199 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:22.785706 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:22.786074 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:22.786433 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:22.786793 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:22.787149 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:22.787518 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:22.787854 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91763) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:22.791225 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.234s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:22.803945 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [req-5ca3e643-a86b-4691-8fae-4260f673bce7 req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] No DVR routers for this DVR port bc64f0d6-a4ca-4f64-a5fc-38bd0631007c on host hv-cinder-79381 {{(pid=91763) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:30:22.806570 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-5ca3e643-a86b-4691-8fae-4260f673bce7 req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:22.809603 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f7619b67-f2eb-4db8-8554-87b1e555294e', 'name': 'network-vif-deleted', 'tag': 'bc64f0d6-a4ca-4f64-a5fc-38bd0631007c'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:30:22.811890 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-87e6dd01-60bc-4231-ac79-6cac1292e644" -d '{"events": [{"server_uuid": "f7619b67-f2eb-4db8-8554-87b1e555294e", "name": "network-vif-deleted", "tag": "bc64f0d6-a4ca-4f64-a5fc-38bd0631007c"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:30:22.827774 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-5ca3e643-a86b-4691-8fae-4260f673bce7 req-e23fd6ac-4f04-4304-9dab-616e3cf68b20 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.63 "DELETE /v2.0/ports/bc64f0d6-a4ca-4f64-a5fc-38bd0631007c HTTP/1.1" status: 204  len: 173 time: 0.8640137
May 31 16:30:22.860864 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:30:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-05fbcca9-2a8d-4d84-b2ea-6deb33cfc89f x-openstack-request-id: req-05fbcca9-2a8d-4d84-b2ea-6deb33cfc89f {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:30:22.861193 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f7619b67-f2eb-4db8-8554-87b1e555294e", "name": "network-vif-deleted", "tag": "bc64f0d6-a4ca-4f64-a5fc-38bd0631007c", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:30:22.861481 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-05fbcca9-2a8d-4d84-b2ea-6deb33cfc89f {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:30:22.863214 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f7619b67-f2eb-4db8-8554-87b1e555294e', 'name': 'network-vif-deleted', 'tag': 'bc64f0d6-a4ca-4f64-a5fc-38bd0631007c', 'status': 'completed', 'code': 200}
May 31 16:30:23.044550 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4300fb93-fb02-47ee-9f80-16e870f48549 req-3bd7eccb-4adf-4905-bab2-cc042bab036c tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=f7619b67-f2eb-4db8-8554-87b1e555294e HTTP/1.1" status: 200  len: 210 time: 0.0511861
May 31 16:30:24.426416 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-c9e274d6-07bc-49fb-91c2-2d6f4dd78f42 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:24.428011 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-c9e274d6-07bc-49fb-91c2-2d6f4dd78f42 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/networks?id=9526c501-6f8f-4f53-8d14-c5917c4cfa9e HTTP/1.1" status: 200  len: 808 time: 0.1631880
May 31 16:30:24.445853 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-9b81b0c6-af21-4f92-b39b-45ab703a42b0 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/quotas/be6bbbcf37dc490480d276accbb4a108 HTTP/1.1" status: 200  len: 375 time: 0.0121512
May 31 16:30:24.496428 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-849f7c78-ec96-4f70-a27a-3fbfe06abdb1 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=be6bbbcf37dc490480d276accbb4a108&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0479107
May 31 16:30:24.786754 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-cee02433-9920-478f-8c9f-466fc63e131b service neutron] 10.222.0.43 "GET /v2.0/networks/9526c501-6f8f-4f53-8d14-c5917c4cfa9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2831893
May 31 16:30:24.920663 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-9573555f-228d-411a-af8f-519b593803a0 service neutron] 10.222.0.43 "GET /v2.0/networks/9526c501-6f8f-4f53-8d14-c5917c4cfa9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1272728
May 31 16:30:25.098175 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9ac33fbf-259d-4e3d-86fc-2b0388b4b72d req-595eed77-94c7-40d3-a778-274257c73902 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=97c73925-2ed7-4253-ace2-b3c112de0e13 HTTP/1.1" status: 200  len: 210 time: 0.0437121
May 31 16:30:26.015510 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 39566) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:30:26.139967 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-ff096abe-37ba-4aad-9998-c315152546a4 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:26.141585 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-ff096abe-37ba-4aad-9998-c315152546a4 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.63 "GET /v2.0/networks?id=9526c501-6f8f-4f53-8d14-c5917c4cfa9e HTTP/1.1" status: 200  len: 808 time: 0.1607554
May 31 16:30:26.154398 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-fc226c28-97f6-4681-80ae-9bb11a6e9433 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Request body: {'port': {'device_id': '97c73925-2ed7-4253-ace2-b3c112de0e13', 'network_id': '9526c501-6f8f-4f53-8d14-c5917c4cfa9e', 'admin_state_up': True, 'tenant_id': 'be6bbbcf37dc490480d276accbb4a108'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:30:26.199661 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-56edf20c-961e-462b-b20f-1d3ddb807bab admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=50928f153a3147309c906abd6dba60d7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1826353
May 31 16:30:26.201367 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 39574) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:30:26.294654 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-9b39e41e-121c-4c58-92ea-38a2f3efcd4f req-57aee6a5-4692-440b-93bc-dc5f2df9f03d tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=97c73925-2ed7-4253-ace2-b3c112de0e13 HTTP/1.1" status: 200  len: 210 time: 0.0596173
May 31 16:30:26.303696 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-fc226c28-97f6-4681-80ae-9bb11a6e9433 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:30:26.308258 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-fc226c28-97f6-4681-80ae-9bb11a6e9433 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Usage tracker for resource:port and tenant:be6bbbcf37dc490480d276accbb4a108 is out of sync, need to count used quota {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:30:26.311280 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-fc226c28-97f6-4681-80ae-9bb11a6e9433 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91763) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:30:26.313018 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-64c00c64-da66-4365-be00-89bcbb6c66de admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:26.317925 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.quota.driver [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-fc226c28-97f6-4681-80ae-9bb11a6e9433 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91763) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:30:26.329092 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-fc226c28-97f6-4681-80ae-9bb11a6e9433 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Made reservation on behalf of be6bbbcf37dc490480d276accbb4a108 for: {'port': 1} {{(pid=91763) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 31 16:30:26.333348 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-fc226c28-97f6-4681-80ae-9bb11a6e9433 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:26.341029 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-64c00c64-da66-4365-be00-89bcbb6c66de admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:26.394559 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-64c00c64-da66-4365-be00-89bcbb6c66de admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:26.399356 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-f0f43ce3-bcbe-476c-8783-5b82b0935b11 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:26.412828 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64c00c64-da66-4365-be00-89bcbb6c66de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b4f00906-9032-43c7-9ede-5a8cb87efb07,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:26.417193 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-64c00c64-da66-4365-be00-89bcbb6c66de admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:26.424544 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-64c00c64-da66-4365-be00-89bcbb6c66de admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:26.429477 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-64c00c64-da66-4365-be00-89bcbb6c66de admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/b4f00906-9032-43c7-9ede-5a8cb87efb07 HTTP/1.1" status: 204  len: 168 time: 0.2267933
May 31 16:30:26.517088 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_common [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-fc226c28-97f6-4681-80ae-9bb11a6e9433 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Allocated IP 172.20.0.14 (9526c501-6f8f-4f53-8d14-c5917c4cfa9e/c3ef4bfd-26df-47c9-b849-a7ffdc14c690/e543424e-17b3-478e-af6d-ffa791175006) {{(pid=91763) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 31 16:30:26.608647 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device bc64f0d6-a4ca-4f64-a5fc-38bd0631007c no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:30:26.647424 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] No Port match for: bc64f0d6-a4ca-4f64-a5fc-38bd0631007c {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:30:26.647824 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device bc64f0d6-a4ca-4f64-a5fc-38bd0631007c not bound to the agent host hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:30:26.742629 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-fc226c28-97f6-4681-80ae-9bb11a6e9433 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Notify callbacks [] for port, precommit_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:26.773639 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-fc226c28-97f6-4681-80ae-9bb11a6e9433 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732784061898', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_create {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:26.779054 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-f0d16892-2bfe-4ec9-9307-cb96d73f094b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:26.848338 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-fc226c28-97f6-4681-80ae-9bb11a6e9433 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Network 9526c501-6f8f-4f53-8d14-c5917c4cfa9e is already hosted by enough agents. {{(pid=91763) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 31 16:30:26.851336 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.base_scheduler [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-fc226c28-97f6-4681-80ae-9bb11a6e9433 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Resources bound (agent type, host, resource id):  {{(pid=91763) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 31 16:30:26.855304 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-fc226c28-97f6-4681-80ae-9bb11a6e9433 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Received port after_create {{(pid=91763) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 31 16:30:26.891001 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc226c28-97f6-4681-80ae-9bb11a6e9433 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Pushing event updated for resources: {'Port': ['ID=e543424e-17b3-478e-af6d-ffa791175006,revision_number=1']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:26.900602 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-fc226c28-97f6-4681-80ae-9bb11a6e9433 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:26.923159 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-fc226c28-97f6-4681-80ae-9bb11a6e9433 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:26.923767 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-fc226c28-97f6-4681-80ae-9bb11a6e9433 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:26.948199 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-fc226c28-97f6-4681-80ae-9bb11a6e9433 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.63 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.7978430
May 31 16:30:26.960500 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.v2.base [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Request body: {'port': {'device_id': '97c73925-2ed7-4253-ace2-b3c112de0e13', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79381'}} {{(pid=91763) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 31 16:30:27.074859 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:27.169601 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:30:27.422684 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e543424e-17b3-478e-af6d-ffa791175006 {{(pid=91763) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:30:27.430579 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Notify callbacks [] for port, precommit_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:27.445674 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.provisioning_blocks [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Transition to ACTIVE for port object e543424e-17b3-478e-af6d-ffa791175006 will not be triggered until provisioned by entity L2. {{(pid=91763) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 31 16:30:27.449305 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14337082'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:27.453919 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:27.488806 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6354baa-9757-4c3e-aa75-3c6af35a100b req-aed1cb69-5a60-48c6-a2b1-1bb2bc3d1f48 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:27.490309 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a6354baa-9757-4c3e-aa75-3c6af35a100b req-aed1cb69-5a60-48c6-a2b1-1bb2bc3d1f48 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=97c73925-2ed7-4253-ace2-b3c112de0e13 HTTP/1.1" status: 200  len: 932 time: 0.0858145
May 31 16:30:27.537160 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a6354baa-9757-4c3e-aa75-3c6af35a100b req-8e62bc82-23ad-422c-8967-41853e637dd5 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/security-groups?id=0cc7c395-a53f-46a5-877c-c098be2d3279&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411024
May 31 16:30:27.584182 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Pushing event updated for resources: {'Port': ['ID=e543424e-17b3-478e-af6d-ffa791175006,revision_number=2']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:27.609749 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:27.687772 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Attempting to bind port e543424e-17b3-478e-af6d-ffa791175006 on host hv-cinder-79381 for vnic_type normal with profile  {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 31 16:30:27.688036 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Attempting to bind port e543424e-17b3-478e-af6d-ffa791175006 by drivers openvswitch,hyperv on host hv-cinder-79381 at level 0 using segments [{'id': 'a23fa11b-36ad-446f-bbcc-5f71f4a7c045', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 847, 'network_id': '9526c501-6f8f-4f53-8d14-c5917c4cfa9e'}] {{(pid=91763) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 31 16:30:27.688342 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Attempting to bind port e543424e-17b3-478e-af6d-ffa791175006 on network 9526c501-6f8f-4f53-8d14-c5917c4cfa9e {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:30:27.693832 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Port e543424e-17b3-478e-af6d-ffa791175006 on network 9526c501-6f8f-4f53-8d14-c5917c4cfa9e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79381 {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 31 16:30:27.694152 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Attempting to bind port e543424e-17b3-478e-af6d-ffa791175006 on network 9526c501-6f8f-4f53-8d14-c5917c4cfa9e {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 31 16:30:27.699352 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Checking agent: {'id': '4bed2638-4d91-4afb-bf81-aacca8584621', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79381', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'started_at': datetime.datetime(2021, 5, 31, 16, 18, 18), 'heartbeat_timestamp': datetime.datetime(2021, 5, 31, 16, 30, 20), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 31 16:30:27.699691 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Checking segment: {'id': 'a23fa11b-36ad-446f-bbcc-5f71f4a7c045', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 847, 'network_id': '9526c501-6f8f-4f53-8d14-c5917c4cfa9e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91763) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 31 16:30:27.700078 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Bound using segment: {'id': 'a23fa11b-36ad-446f-bbcc-5f71f4a7c045', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 847, 'network_id': '9526c501-6f8f-4f53-8d14-c5917c4cfa9e'} {{(pid=91763) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 31 16:30:27.700509 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.managers [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Bound port: e543424e-17b3-478e-af6d-ffa791175006, host: hv-cinder-79381, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a23fa11b-36ad-446f-bbcc-5f71f4a7c045', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 847, 'network_id': '9526c501-6f8f-4f53-8d14-c5917c4cfa9e'}}] {{(pid=91763) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 31 16:30:27.700858 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:27.879852 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] For port e543424e-17b3-478e-af6d-ffa791175006, host hv-cinder-79381, cleared binding levels {{(pid=91763) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 31 16:30:27.882804 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] For port e543424e-17b3-478e-af6d-ffa791175006, host hv-cinder-79381, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=e543424e-17b3-478e-af6d-ffa791175006,segment=NetworkSegment(a23fa11b-36ad-446f-bbcc-5f71f4a7c045),segment_id=a23fa11b-36ad-446f-bbcc-5f71f4a7c045)] {{(pid=91763) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 31 16:30:27.887176 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14337082'] for port, after_update {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:27.890655 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-2b55d7c3-918a-4cd1-98dd-b9cff541d737 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:27.948398 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:27.948941 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:27.950357 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] 10.222.0.63 "PUT /v2.0/ports/e543424e-17b3-478e-af6d-ffa791175006 HTTP/1.1" status: 200  len: 1094 time: 0.9943767
May 31 16:30:27.950855 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '97c73925-2ed7-4253-ace2-b3c112de0e13', 'tag': 'e543424e-17b3-478e-af6d-ffa791175006'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:30:27.953111 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5c9ad782-a15a-4f83-b6c4-750cadbd8ecf" -d '{"events": [{"name": "network-changed", "server_uuid": "97c73925-2ed7-4253-ace2-b3c112de0e13", "tag": "e543424e-17b3-478e-af6d-ffa791175006"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:30:27.970987 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Pushing event updated for resources: {'Port': ['ID=e543424e-17b3-478e-af6d-ffa791175006,revision_number=3']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:27.974494 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-8f4d5e97-a137-4894-beb9-694dc8a8f07f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:28.071061 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-54756f9f-6e7f-4b7f-a6b1-b06952c55d7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:28.072543 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-54756f9f-6e7f-4b7f-a6b1-b06952c55d7a service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=be6bbbcf37dc490480d276accbb4a108&device_id=97c73925-2ed7-4253-ace2-b3c112de0e13 HTTP/1.1" status: 200  len: 1097 time: 0.0773013
May 31 16:30:28.143585 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-f800514c-7f0b-449d-914d-024543c1b2bd service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e543424e-17b3-478e-af6d-ffa791175006 HTTP/1.1" status: 200  len: 217 time: 0.0618827
May 31 16:30:28.207105 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:30:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d35fda83-61a9-40f1-8833-27ba11494d5a x-openstack-request-id: req-d35fda83-61a9-40f1-8833-27ba11494d5a {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:30:28.207433 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "97c73925-2ed7-4253-ace2-b3c112de0e13", "tag": "e543424e-17b3-478e-af6d-ffa791175006", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:30:28.207722 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-d35fda83-61a9-40f1-8833-27ba11494d5a {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:30:28.208152 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '97c73925-2ed7-4253-ace2-b3c112de0e13', 'tag': 'e543424e-17b3-478e-af6d-ffa791175006', 'status': 'completed', 'code': 200}
May 31 16:30:28.213451 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-83dcee50-af6a-4e0e-a6b2-c4e2e19509f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:28.214910 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-83dcee50-af6a-4e0e-a6b2-c4e2e19509f6 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=c3ef4bfd-26df-47c9-b849-a7ffdc14c690 HTTP/1.1" status: 200  len: 848 time: 0.0645039
May 31 16:30:28.263744 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-144a062d-2473-455a-bd44-48cd949ab203 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=9526c501-6f8f-4f53-8d14-c5917c4cfa9e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0397024
May 31 16:30:28.395950 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-db2ff169-6b92-42e7-8c5b-88bc04ae19c2 service neutron] 10.222.0.63 "GET /v2.0/networks/9526c501-6f8f-4f53-8d14-c5917c4cfa9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1235499
May 31 16:30:28.532342 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-0566deaf-fd4c-4baf-99a1-4a48d2ac89f0 req-8924bc17-bd1a-4f73-b7a6-d7c9d3831bbf service neutron] 10.222.0.63 "GET /v2.0/networks/9526c501-6f8f-4f53-8d14-c5917c4cfa9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1285868
May 31 16:30:28.652992 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c9ad782-a15a-4f83-b6c4-750cadbd8ecf req-fd2aa2f4-f359-4ffe-8337-0ed117b9ec60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:28.654503 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-5c9ad782-a15a-4f83-b6c4-750cadbd8ecf req-fd2aa2f4-f359-4ffe-8337-0ed117b9ec60 service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=be6bbbcf37dc490480d276accbb4a108&device_id=97c73925-2ed7-4253-ace2-b3c112de0e13 HTTP/1.1" status: 200  len: 1097 time: 0.0768991
May 31 16:30:28.729019 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fca0ba6-0b8e-47c4-bf5e-c45768165b31 req-e0f1ca9a-2ae9-4448-b88c-00b23da8233e tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:28.730529 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1fca0ba6-0b8e-47c4-bf5e-c45768165b31 req-e0f1ca9a-2ae9-4448-b88c-00b23da8233e tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=97c73925-2ed7-4253-ace2-b3c112de0e13 HTTP/1.1" status: 200  len: 944 time: 0.0846195
May 31 16:30:28.782666 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-1fca0ba6-0b8e-47c4-bf5e-c45768165b31 req-ed14dbc9-a9ce-48e2-aab4-57543b0422c7 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/security-groups?id=0cc7c395-a53f-46a5-877c-c098be2d3279&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0461099
May 31 16:30:28.797844 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c9ad782-a15a-4f83-b6c4-750cadbd8ecf req-c7d6707c-3857-4d23-bad7-9801eacf94cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:28.799292 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-5c9ad782-a15a-4f83-b6c4-750cadbd8ecf req-c7d6707c-3857-4d23-bad7-9801eacf94cb service neutron] 10.222.0.63 "GET /v2.0/networks?id=9526c501-6f8f-4f53-8d14-c5917c4cfa9e HTTP/1.1" status: 200  len: 909 time: 0.1372952
May 31 16:30:28.867623 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-5c9ad782-a15a-4f83-b6c4-750cadbd8ecf req-317f956c-deb1-4b00-8f0e-acde8a32ec35 service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e543424e-17b3-478e-af6d-ffa791175006 HTTP/1.1" status: 200  len: 217 time: 0.0606241
May 31 16:30:28.936567 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c9ad782-a15a-4f83-b6c4-750cadbd8ecf req-2a2e0136-9620-4dfb-b11e-965226a0e725 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:28.938032 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-5c9ad782-a15a-4f83-b6c4-750cadbd8ecf req-2a2e0136-9620-4dfb-b11e-965226a0e725 service neutron] 10.222.0.63 "GET /v2.0/subnets?id=c3ef4bfd-26df-47c9-b849-a7ffdc14c690 HTTP/1.1" status: 200  len: 848 time: 0.0631504
May 31 16:30:28.989799 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-5c9ad782-a15a-4f83-b6c4-750cadbd8ecf req-bca35904-8ebf-445d-8dd5-dfb3e9e61672 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=9526c501-6f8f-4f53-8d14-c5917c4cfa9e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0422308
May 31 16:30:29.141176 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-5c9ad782-a15a-4f83-b6c4-750cadbd8ecf req-2ca180c4-70da-4d76-aed5-d1b926328847 service neutron] 10.222.0.63 "GET /v2.0/networks/9526c501-6f8f-4f53-8d14-c5917c4cfa9e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1411359
May 31 16:30:29.279030 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-5c9ad782-a15a-4f83-b6c4-750cadbd8ecf req-07b39dae-e98e-4a19-8b15-b39792bd8ac3 service neutron] 10.222.0.63 "GET /v2.0/networks/9526c501-6f8f-4f53-8d14-c5917c4cfa9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1296401
May 31 16:30:29.976629 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd23c34e-c452-4202-8267-59093b93b6c3 req-ff09f505-726f-435e-88b1-511199b63054 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:29.978181 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-fd23c34e-c452-4202-8267-59093b93b6c3 req-ff09f505-726f-435e-88b1-511199b63054 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=97c73925-2ed7-4253-ace2-b3c112de0e13 HTTP/1.1" status: 200  len: 944 time: 0.0856957
May 31 16:30:30.026059 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-fd23c34e-c452-4202-8267-59093b93b6c3 req-35a9684e-e18a-49b1-a738-f7e50f8f22f4 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/security-groups?id=0cc7c395-a53f-46a5-877c-c098be2d3279&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0420096
May 31 16:30:30.647269 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device e543424e-17b3-478e-af6d-ffa791175006 details requested by agent hyperv_hv-cinder-79381 with host hv-cinder-79381 {{(pid=91765) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 31 16:30:30.778962 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port e543424e-17b3-478e-af6d-ffa791175006, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=e543424e-17b3-478e-af6d-ffa791175006,segment=NetworkSegment(a23fa11b-36ad-446f-bbcc-5f71f4a7c045),segment_id=a23fa11b-36ad-446f-bbcc-5f71f4a7c045)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:30:30.792624 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Returning: {'device': 'e543424e-17b3-478e-af6d-ffa791175006', 'network_id': '9526c501-6f8f-4f53-8d14-c5917c4cfa9e', 'port_id': 'e543424e-17b3-478e-af6d-ffa791175006', 'mac_address': 'fa:16:3e:ee:54:31', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 847, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c3ef4bfd-26df-47c9-b849-a7ffdc14c690', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91765) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 31 16:30:30.852201 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:30.869198 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e543424e-17b3-478e-af6d-ffa791175006 {{(pid=91765) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 31 16:30:30.884415 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port e543424e-17b3-478e-af6d-ffa791175006, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=e543424e-17b3-478e-af6d-ffa791175006,segment=NetworkSegment(a23fa11b-36ad-446f-bbcc-5f71f4a7c045),segment_id=a23fa11b-36ad-446f-bbcc-5f71f4a7c045)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:30:30.888178 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:30.889963 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:30.955049 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=e543424e-17b3-478e-af6d-ffa791175006,revision_number=4']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:30.958262 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:31.114356 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['e543424e-17b3-478e-af6d-ffa791175006'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:30:31.225097 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbcd7b89-13e3-49b4-a185-a87f4075ea11 req-e82f5fb0-8d15-4eba-bc8e-466d2f9c11eb tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:31.226724 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-fbcd7b89-13e3-49b4-a185-a87f4075ea11 req-e82f5fb0-8d15-4eba-bc8e-466d2f9c11eb tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=97c73925-2ed7-4253-ace2-b3c112de0e13 HTTP/1.1" status: 200  len: 945 time: 0.0913022
May 31 16:30:31.274439 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-fbcd7b89-13e3-49b4-a185-a87f4075ea11 req-4e5355ab-aa23-4c68-8588-3e48433a2afc tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/security-groups?id=0cc7c395-a53f-46a5-877c-c098be2d3279&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417829
May 31 16:30:32.458416 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9c5fd6f-dddc-48a9-a6d5-4c609384648e req-3baf4afe-854c-4cfe-9bed-aaef12d497af tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:32.459850 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c9c5fd6f-dddc-48a9-a6d5-4c609384648e req-3baf4afe-854c-4cfe-9bed-aaef12d497af tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=97c73925-2ed7-4253-ace2-b3c112de0e13 HTTP/1.1" status: 200  len: 945 time: 0.0801294
May 31 16:30:32.503954 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-c9c5fd6f-dddc-48a9-a6d5-4c609384648e req-131a7c42-b7cf-45af-90eb-2aba8ab26179 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/security-groups?id=0cc7c395-a53f-46a5-877c-c098be2d3279&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0384703
May 31 16:30:32.656065 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device e543424e-17b3-478e-af6d-ffa791175006 up at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 31 16:30:32.724913 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning for port e543424e-17b3-478e-af6d-ffa791175006 completed by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 31 16:30:32.729838 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.provisioning_blocks [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Provisioning complete for port e543424e-17b3-478e-af6d-ffa791175006 triggered by entity L2. {{(pid=91765) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 31 16:30:32.730217 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-990738'] for port, provisioning_complete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:32.847510 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-639268'] for port, before_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:32.875177 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '97c73925-2ed7-4253-ace2-b3c112de0e13', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e543424e-17b3-478e-af6d-ffa791175006'}] {{(pid=91765) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:30:32.877661 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01457b26c82bcf6365a4b0349880df366064c1fef080776a5578632ad1dca210" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3811113f-057e-4386-a6d9-fa31b3f69c67" -d '{"events": [{"server_uuid": "97c73925-2ed7-4253-ace2-b3c112de0e13", "name": "network-vif-plugged", "status": "completed", "tag": "e543424e-17b3-478e-af6d-ffa791175006"}]}' {{(pid=91765) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:30:32.886454 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] For port e543424e-17b3-478e-af6d-ffa791175006, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=e543424e-17b3-478e-af6d-ffa791175006,segment=NetworkSegment(a23fa11b-36ad-446f-bbcc-5f71f4a7c045),segment_id=a23fa11b-36ad-446f-bbcc-5f71f4a7c045)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:30:32.890301 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732784445332', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732784061916', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732784061197'] for port, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:32.892974 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:32.927193 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:30:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e6d5056b-ef9a-4b85-85cc-e38eb0b41048 x-openstack-request-id: req-e6d5056b-ef9a-4b85-85cc-e38eb0b41048 {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:30:32.927499 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "97c73925-2ed7-4253-ace2-b3c112de0e13", "name": "network-vif-plugged", "status": "completed", "tag": "e543424e-17b3-478e-af6d-ffa791175006", "code": 200}]} {{(pid=91765) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:30:32.927760 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-e6d5056b-ef9a-4b85-85cc-e38eb0b41048 {{(pid=91765) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:30:32.931499 dv-cinder-793814-1-iscsi neutron-server[91765]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '97c73925-2ed7-4253-ace2-b3c112de0e13', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e543424e-17b3-478e-af6d-ffa791175006', 'code': 200}
May 31 16:30:32.973562 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Pushing event updated for resources: {'Port': ['ID=e543424e-17b3-478e-af6d-ffa791175006,revision_number=5']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:32.982619 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:32.982965 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:32.983369 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:32.983625 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:32.983987 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:32.984280 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:32.984617 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:32.984989 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:32.985371 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:32.985725 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:32.986238 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:32.986371 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91765) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:30:32.990729 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:33.163325 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbfde5ea-1c3a-4786-8ab0-e8817e1689b9 req-8a243742-5b58-44c4-aefd-20b73bc9b3ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:33.164638 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-fbfde5ea-1c3a-4786-8ab0-e8817e1689b9 req-8a243742-5b58-44c4-aefd-20b73bc9b3ae service neutron] 10.222.0.63 "GET /v2.0/ports?device_id=97c73925-2ed7-4253-ace2-b3c112de0e13 HTTP/1.1" status: 200  len: 1099 time: 0.0724907
May 31 16:30:33.211489 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-fbfde5ea-1c3a-4786-8ab0-e8817e1689b9 req-fd2e8c91-f2ad-4102-b84b-ae7212e4934f service neutron] 10.222.0.63 "GET /v2.0/security-groups?id=0cc7c395-a53f-46a5-877c-c098be2d3279&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0401847
May 31 16:30:33.698819 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ef187ff-6987-4442-aaed-f351856ea82e req-5f4dcfd0-b0e6-4ee6-92b1-542327c0bef1 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:33.700644 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7ef187ff-6987-4442-aaed-f351856ea82e req-5f4dcfd0-b0e6-4ee6-92b1-542327c0bef1 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=97c73925-2ed7-4253-ace2-b3c112de0e13 HTTP/1.1" status: 200  len: 946 time: 0.0919085
May 31 16:30:33.745991 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-7ef187ff-6987-4442-aaed-f351856ea82e req-cf2fe8f3-d534-4380-9859-f8bc845f3e6a tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/security-groups?id=0cc7c395-a53f-46a5-877c-c098be2d3279&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388508
May 31 16:30:35.015627 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-9f8531be-0630-42b0-ae0b-108e6da370f1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:35.083562 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4abc6024-fc12-4ae5-881c-1ba7863b238e req-bfd1ca27-ce54-44ca-ab2f-ce80ef1dc409 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:35.084998 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4abc6024-fc12-4ae5-881c-1ba7863b238e req-bfd1ca27-ce54-44ca-ab2f-ce80ef1dc409 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=97c73925-2ed7-4253-ace2-b3c112de0e13 HTTP/1.1" status: 200  len: 946 time: 0.0809090
May 31 16:30:35.131073 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-4abc6024-fc12-4ae5-881c-1ba7863b238e req-fb14b020-3df0-4996-940e-722f5d616d3f tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/security-groups?id=0cc7c395-a53f-46a5-877c-c098be2d3279&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403953
May 31 16:30:36.320040 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0c91d7e-bcf6-4082-910b-f84430e92544 req-d7a7fe1a-c4d2-4b85-a6a2-d975654bafa1 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:36.321548 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b0c91d7e-bcf6-4082-910b-f84430e92544 req-d7a7fe1a-c4d2-4b85-a6a2-d975654bafa1 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=97c73925-2ed7-4253-ace2-b3c112de0e13 HTTP/1.1" status: 200  len: 946 time: 0.0891335
May 31 16:30:36.374766 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-b0c91d7e-bcf6-4082-910b-f84430e92544 req-0635b627-f837-4b9c-9dda-8c11ba146090 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/security-groups?id=0cc7c395-a53f-46a5-877c-c098be2d3279&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0466616
May 31 16:30:37.583288 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcd5b939-b27b-4569-b6a2-ca59c638fcb5 req-7643cda1-abd0-4758-9c6a-13818b8ac09b tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:37.584886 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bcd5b939-b27b-4569-b6a2-ca59c638fcb5 req-7643cda1-abd0-4758-9c6a-13818b8ac09b tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=97c73925-2ed7-4253-ace2-b3c112de0e13 HTTP/1.1" status: 200  len: 946 time: 0.0881639
May 31 16:30:37.608028 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb564e8c-30be-4636-a034-131634b3f9c3 req-b294cb9c-d4a2-43ff-b968-69b271d2f2a3 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:30:37.609166 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-fb564e8c-30be-4636-a034-131634b3f9c3 req-b294cb9c-d4a2-43ff-b968-69b271d2f2a3 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Synchronizing usage tracker for tenant:be6bbbcf37dc490480d276accbb4a108 on resource:port {{(pid=91763) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:30:37.629448 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-fb564e8c-30be-4636-a034-131634b3f9c3 req-b294cb9c-d4a2-43ff-b968-69b271d2f2a3 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Unset dirty status for tenant:be6bbbcf37dc490480d276accbb4a108 on resource:port {{(pid=91763) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:30:37.630854 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-fb564e8c-30be-4636-a034-131634b3f9c3 req-b294cb9c-d4a2-43ff-b968-69b271d2f2a3 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.63 "GET /v2.0/ports?device_id=97c73925-2ed7-4253-ace2-b3c112de0e13 HTTP/1.1" status: 200  len: 946 time: 0.1090798
May 31 16:30:37.642130 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-bcd5b939-b27b-4569-b6a2-ca59c638fcb5 req-aac36cc5-9fd3-40d0-ad9e-0b2374c262ae tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/security-groups?id=0cc7c395-a53f-46a5-877c-c098be2d3279&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0512280
May 31 16:30:37.906789 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-fb564e8c-30be-4636-a034-131634b3f9c3 req-cb79ea08-9012-4ec0-8380-7af0b8a71efb tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Deleting port e543424e-17b3-478e-af6d-ffa791175006 {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:30:37.907092 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-fb564e8c-30be-4636-a034-131634b3f9c3 req-cb79ea08-9012-4ec0-8380-7af0b8a71efb tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:37.908583 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:38.070358 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-fb564e8c-30be-4636-a034-131634b3f9c3 req-cb79ea08-9012-4ec0-8380-7af0b8a71efb tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] For port e543424e-17b3-478e-af6d-ffa791175006, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=e543424e-17b3-478e-af6d-ffa791175006,segment=NetworkSegment(a23fa11b-36ad-446f-bbcc-5f71f4a7c045),segment_id=a23fa11b-36ad-446f-bbcc-5f71f4a7c045)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:30:38.070734 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-fb564e8c-30be-4636-a034-131634b3f9c3 req-cb79ea08-9012-4ec0-8380-7af0b8a71efb tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:38.201125 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-fb564e8c-30be-4636-a034-131634b3f9c3 req-cb79ea08-9012-4ec0-8380-7af0b8a71efb tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Calling delete_port for e543424e-17b3-478e-af6d-ffa791175006 owned by compute:nova {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:30:38.239412 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-8d0a8f76-7b7a-4abe-9450-e74f0781c202 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:38.327448 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-fb564e8c-30be-4636-a034-131634b3f9c3 req-cb79ea08-9012-4ec0-8380-7af0b8a71efb tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:38.334578 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-f6351b9f-8175-4747-b8f3-9e60d061337c tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:30:38.339883 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] get_ports_and_sgs() called for port_ids ['e543424e-17b3-478e-af6d-ffa791175006'] {{(pid=91765) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 31 16:30:38.382876 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb79ea08-9012-4ec0-8380-7af0b8a71efb tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Pushing event deleted for resources: {'Port': ['ID=e543424e-17b3-478e-af6d-ffa791175006,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:30:38.415948 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-cb79ea08-9012-4ec0-8380-7af0b8a71efb tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:30:38.465918 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [req-fb564e8c-30be-4636-a034-131634b3f9c3 req-cb79ea08-9012-4ec0-8380-7af0b8a71efb tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] No DVR routers for this DVR port e543424e-17b3-478e-af6d-ffa791175006 on host hv-cinder-79381 {{(pid=91763) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:30:38.468614 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-fb564e8c-30be-4636-a034-131634b3f9c3 req-cb79ea08-9012-4ec0-8380-7af0b8a71efb tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:38.471934 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '97c73925-2ed7-4253-ace2-b3c112de0e13', 'name': 'network-vif-deleted', 'tag': 'e543424e-17b3-478e-af6d-ffa791175006'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:30:38.474312 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3205bd3f-2be0-4ddb-96bd-abf7eaf80db9" -d '{"events": [{"server_uuid": "97c73925-2ed7-4253-ace2-b3c112de0e13", "name": "network-vif-deleted", "tag": "e543424e-17b3-478e-af6d-ffa791175006"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:30:38.489204 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-fb564e8c-30be-4636-a034-131634b3f9c3 req-cb79ea08-9012-4ec0-8380-7af0b8a71efb tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.63 "DELETE /v2.0/ports/e543424e-17b3-478e-af6d-ffa791175006 HTTP/1.1" status: 204  len: 173 time: 0.8514056
May 31 16:30:38.526736 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:30:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1ed8417a-dbe3-4a4a-89a8-9831e9f639f6 x-openstack-request-id: req-1ed8417a-dbe3-4a4a-89a8-9831e9f639f6 {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:30:38.527071 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "97c73925-2ed7-4253-ace2-b3c112de0e13", "name": "network-vif-deleted", "tag": "e543424e-17b3-478e-af6d-ffa791175006", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:30:38.527366 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-1ed8417a-dbe3-4a4a-89a8-9831e9f639f6 {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:30:38.527796 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '97c73925-2ed7-4253-ace2-b3c112de0e13', 'name': 'network-vif-deleted', 'tag': 'e543424e-17b3-478e-af6d-ffa791175006', 'status': 'completed', 'code': 200}
May 31 16:30:38.811387 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-69dd1e09-e64b-40f8-97f5-e3ee814a82c8 req-028d12c1-d91e-43dd-bff7-fc6047446885 tempest-VolumesActionsTest-360964100 tempest-VolumesActionsTest-360964100-project] 10.222.0.43 "GET /v2.0/ports?device_id=97c73925-2ed7-4253-ace2-b3c112de0e13 HTTP/1.1" status: 200  len: 210 time: 0.0445440
May 31 16:30:39.188143 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:40.897719 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:30:43.399366 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device e543424e-17b3-478e-af6d-ffa791175006 no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:30:43.450088 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] No Port match for: e543424e-17b3-478e-af6d-ffa791175006 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:30:43.450458 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device e543424e-17b3-478e-af6d-ffa791175006 not bound to the agent host hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:30:49.693593 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:01.785172 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 39840) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:31:01.847935 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.db_base_plugin_v2 [None req-8823e1b0-30d5-481f-8a02-3d5345f8e3e8 admin admin] Deleting subnet c3ef4bfd-26df-47c9-b849-a7ffdc14c690 {{(pid=91764) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 31 16:31:01.851163 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-8823e1b0-30d5-481f-8a02-3d5345f8e3e8 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:01.904972 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-8823e1b0-30d5-481f-8a02-3d5345f8e3e8 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14907384'] for subnet, precommit_delete_associations {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:01.962147 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-8823e1b0-30d5-481f-8a02-3d5345f8e3e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-975336'] for subnet, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:02.320319 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-8823e1b0-30d5-481f-8a02-3d5345f8e3e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-978269', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14907170', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14793691'] for subnet, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:02.324089 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:02.360920 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8823e1b0-30d5-481f-8a02-3d5345f8e3e8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c3ef4bfd-26df-47c9-b849-a7ffdc14c690,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:02.365151 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-8823e1b0-30d5-481f-8a02-3d5345f8e3e8 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:02.373334 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8823e1b0-30d5-481f-8a02-3d5345f8e3e8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:31:02.373728 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8823e1b0-30d5-481f-8a02-3d5345f8e3e8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:31:02.374109 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8823e1b0-30d5-481f-8a02-3d5345f8e3e8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:31:02.374481 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8823e1b0-30d5-481f-8a02-3d5345f8e3e8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:31:02.374851 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8823e1b0-30d5-481f-8a02-3d5345f8e3e8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:31:02.375215 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8823e1b0-30d5-481f-8a02-3d5345f8e3e8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:31:02.375584 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8823e1b0-30d5-481f-8a02-3d5345f8e3e8 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:31:02.375947 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8823e1b0-30d5-481f-8a02-3d5345f8e3e8 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:31:02.376310 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8823e1b0-30d5-481f-8a02-3d5345f8e3e8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:31:02.376673 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8823e1b0-30d5-481f-8a02-3d5345f8e3e8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:31:02.377821 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8823e1b0-30d5-481f-8a02-3d5345f8e3e8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:31:02.378186 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8823e1b0-30d5-481f-8a02-3d5345f8e3e8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793814-1-iscsi {{(pid=91764) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 31 16:31:02.382016 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-8823e1b0-30d5-481f-8a02-3d5345f8e3e8 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/c3ef4bfd-26df-47c9-b849-a7ffdc14c690 HTTP/1.1" status: 204  len: 168 time: 0.5956998
May 31 16:31:02.382925 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-8823e1b0-30d5-481f-8a02-3d5345f8e3e8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:02.384497 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 39844) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:31:02.415083 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 39848) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:31:02.496320 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-58447afe-ce76-424a-bbe6-7a5ddef8b5cd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-525980'] for network, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:02.628244 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-58447afe-ce76-424a-bbe6-7a5ddef8b5cd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-988775', 'neutron.services.segments.db._delete_segments_for_network-8732784586204'] for network, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:02.642484 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-58447afe-ce76-424a-bbe6-7a5ddef8b5cd admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f1426750fa0>,) {'filters': {'network_id': ['9526c501-6f8f-4f53-8d14-c5917c4cfa9e']}} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:31:02.657298 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-58447afe-ce76-424a-bbe6-7a5ddef8b5cd admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f1426750fa0>, 'a23fa11b-36ad-446f-bbcc-5f71f4a7c045') {'for_net_delete': True} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:31:02.657636 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.services.segments.db [None req-58447afe-ce76-424a-bbe6-7a5ddef8b5cd admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f1426750fa0>, 'a23fa11b-36ad-446f-bbcc-5f71f4a7c045') {} {{(pid=91764) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:31:02.670213 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-58447afe-ce76-424a-bbe6-7a5ddef8b5cd admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732784599197', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14907379'] for segment, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:02.687016 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-58447afe-ce76-424a-bbe6-7a5ddef8b5cd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:02.696273 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-58447afe-ce76-424a-bbe6-7a5ddef8b5cd admin admin] Releasing vlan 847 on physical network physnet1 to pool {{(pid=91764) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 31 16:31:02.696678 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-58447afe-ce76-424a-bbe6-7a5ddef8b5cd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14905732'] for segment, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:02.707211 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-551c67e0-dc5f-4ad5-9cdf-9e4fcf246bfe tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Deleting port 5a028dac-261a-4424-8089-c4820c3cf050 {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:31:02.708145 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-551c67e0-dc5f-4ad5-9cdf-9e4fcf246bfe tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]: Traceback (most recent call last):
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:     timer()
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:     cb(*args, **kw)
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:     return func(*args, **kwargs)
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:     self._notify()
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:     self.callback(batched_events)
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:     event.method(event)
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:     aggregate_uuid = self.p_client.list_aggregates(
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:     return f(self, *a, **k)
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self._get(url).json()
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:     return self.request(url, 'GET', **kwargs)
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:     base_url = self.get_endpoint(auth, allow=allow,
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 31 16:31:02.711486 dv-cinder-793814-1-iscsi neutron-server[91764]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 31 16:31:02.793692 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-58447afe-ce76-424a-bbe6-7a5ddef8b5cd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16621775'] for network, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:02.797348 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:02.811416 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-58447afe-ce76-424a-bbe6-7a5ddef8b5cd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:02.823443 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58447afe-ce76-424a-bbe6-7a5ddef8b5cd admin admin] Pushing event deleted for resources: {'Network': ['ID=9526c501-6f8f-4f53-8d14-c5917c4cfa9e,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:02.826892 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-58447afe-ce76-424a-bbe6-7a5ddef8b5cd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:02.834288 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-58447afe-ce76-424a-bbe6-7a5ddef8b5cd admin admin] 10.222.0.43 "DELETE /v2.0/networks/9526c501-6f8f-4f53-8d14-c5917c4cfa9e HTTP/1.1" status: 204  len: 168 time: 0.4485853
May 31 16:31:02.844791 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-551c67e0-dc5f-4ad5-9cdf-9e4fcf246bfe tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:02.845128 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-551c67e0-dc5f-4ad5-9cdf-9e4fcf246bfe tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:02.973800 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-551c67e0-dc5f-4ad5-9cdf-9e4fcf246bfe tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Calling delete_port for 5a028dac-261a-4424-8089-c4820c3cf050 owned by network:floatingip {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:31:03.059345 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 39854) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:31:03.115452 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-90310261-f9fc-4a42-8fe1-b757fca66dba admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=be6bbbcf37dc490480d276accbb4a108&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0546899
May 31 16:31:03.117611 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 39858) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:31:03.121784 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-551c67e0-dc5f-4ad5-9cdf-9e4fcf246bfe tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:03.126096 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-3cca5dc6-ee82-4b56-88dd-3b6928643006 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:03.172051 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-551c67e0-dc5f-4ad5-9cdf-9e4fcf246bfe tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Pushing event deleted for resources: {'Port': ['ID=5a028dac-261a-4424-8089-c4820c3cf050,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:03.176688 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-551c67e0-dc5f-4ad5-9cdf-9e4fcf246bfe tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:03.192244 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-53ae8c1c-ef7e-41b7-b3ca-b2db26a53cb5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:03.219630 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-53ae8c1c-ef7e-41b7-b3ca-b2db26a53cb5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:03.270154 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-551c67e0-dc5f-4ad5-9cdf-9e4fcf246bfe tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for floatingip, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:03.272784 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.db.l3_db [None req-551c67e0-dc5f-4ad5-9cdf-9e4fcf246bfe tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Floating IP cb7b2aba-d9dd-40bd-a8db-2affe7258aae disassociated (deleted). External IP: 172.27.0.87, port: e42a29cb-c29c-41f8-9cfb-6379c167a596.
May 31 16:31:03.278308 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-53ae8c1c-ef7e-41b7-b3ca-b2db26a53cb5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:03.282662 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-5ed122b0-150d-4cd0-be62-8900f0ebee34 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:03.299521 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53ae8c1c-ef7e-41b7-b3ca-b2db26a53cb5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0cc7c395-a53f-46a5-877c-c098be2d3279,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:03.303565 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-53ae8c1c-ef7e-41b7-b3ca-b2db26a53cb5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:03.311327 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-53ae8c1c-ef7e-41b7-b3ca-b2db26a53cb5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:03.314772 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-53ae8c1c-ef7e-41b7-b3ca-b2db26a53cb5 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/0cc7c395-a53f-46a5-877c-c098be2d3279 HTTP/1.1" status: 204  len: 168 time: 0.1936526
May 31 16:31:03.777197 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-551c67e0-dc5f-4ad5-9cdf-9e4fcf246bfe tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Router 9e698298-b838-4dbb-939c-c84fb0148003 has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91763) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:31:03.972617 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-551c67e0-dc5f-4ad5-9cdf-9e4fcf246bfe tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:31:03.990827 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ddfdca13-e08b-4bac-9f08-446048ea64c0 None None] Sync routers for ids ['9e698298-b838-4dbb-939c-c84fb0148003'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:31:04.006338 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-551c67e0-dc5f-4ad5-9cdf-9e4fcf246bfe tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for floatingip, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:04.015168 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ddfdca13-e08b-4bac-9f08-446048ea64c0 None None] Routers {'9e698298-b838-4dbb-939c-c84fb0148003'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:31:04.016080 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-ddfdca13-e08b-4bac-9f08-446048ea64c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f142710e3d0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:30:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['9e698298-b838-4dbb-939c-c84fb0148003'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:31:04.075711 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-551c67e0-dc5f-4ad5-9cdf-9e4fcf246bfe tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "DELETE /v2.0/floatingips/cb7b2aba-d9dd-40bd-a8db-2affe7258aae HTTP/1.1" status: 204  len: 168 time: 1.6578963
May 31 16:31:04.075711 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd9e580af-3588-40d6-9e2a-60c321af3d1e', 'tag': 'e42a29cb-c29c-41f8-9cfb-6379c167a596'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:31:04.077737 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7281214a-bb57-4476-96af-d0ad9797598f" -d '{"events": [{"name": "network-changed", "server_uuid": "d9e580af-3588-40d6-9e2a-60c321af3d1e", "tag": "e42a29cb-c29c-41f8-9cfb-6379c167a596"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:31:04.161088 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Mon, 31 May 2021 16:31:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-92ff7bfc-ec67-40ea-85dc-1168d1827173 x-openstack-request-id: req-92ff7bfc-ec67-40ea-85dc-1168d1827173 {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:31:04.161415 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d9e580af-3588-40d6-9e2a-60c321af3d1e", "tag": "e42a29cb-c29c-41f8-9cfb-6379c167a596", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:31:04.161733 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-92ff7bfc-ec67-40ea-85dc-1168d1827173 {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:31:04.162158 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd9e580af-3588-40d6-9e2a-60c321af3d1e', 'tag': 'e42a29cb-c29c-41f8-9cfb-6379c167a596', 'status': 'completed', 'code': 200}
May 31 16:31:04.179202 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:31:04.251441 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-ddfdca13-e08b-4bac-9f08-446048ea64c0 None None] Set router 9e698298-b838-4dbb-939c-c84fb0148003 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:31:04.335567 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7281214a-bb57-4476-96af-d0ad9797598f req-f105461d-eaba-460b-8a02-6192bbcb46bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:31:04.337358 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7281214a-bb57-4476-96af-d0ad9797598f req-f105461d-eaba-460b-8a02-6192bbcb46bb service neutron] 10.222.0.63 "GET /v2.0/ports?tenant_id=ff0bbba58394409987a388bb38868b4e&device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 1099 time: 0.1459470
May 31 16:31:04.494253 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7281214a-bb57-4476-96af-d0ad9797598f req-e03c1cea-30f6-43b0-a423-2a46a0e5a1d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:31:04.495732 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7281214a-bb57-4476-96af-d0ad9797598f req-e03c1cea-30f6-43b0-a423-2a46a0e5a1d5 service neutron] 10.222.0.63 "GET /v2.0/networks?id=0e202b3d-d60d-481f-bf3a-e31943668c98 HTTP/1.1" status: 200  len: 909 time: 0.1516340
May 31 16:31:04.584352 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7281214a-bb57-4476-96af-d0ad9797598f req-5c6372d7-385f-4c71-8be9-bc581b38c9bd service neutron] 10.222.0.63 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=e42a29cb-c29c-41f8-9cfb-6379c167a596 HTTP/1.1" status: 200  len: 217 time: 0.0799391
May 31 16:31:04.608437 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb6f874f-c2af-4277-99b2-c901d3f33e5b req-e7130eff-14a2-4465-9d1a-dae78a92790f tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:31:04.617708 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-eb6f874f-c2af-4277-99b2-c901d3f33e5b req-e7130eff-14a2-4465-9d1a-dae78a92790f tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.1467562
May 31 16:31:04.677628 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7281214a-bb57-4476-96af-d0ad9797598f req-ebcb1dc4-d5de-4ef6-8ee1-a8be4d8e197f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:31:04.677628 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7281214a-bb57-4476-96af-d0ad9797598f req-ebcb1dc4-d5de-4ef6-8ee1-a8be4d8e197f service neutron] 10.222.0.63 "GET /v2.0/subnets?id=20f6caad-2e13-4108-af8f-f9c2336ccde2 HTTP/1.1" status: 200  len: 847 time: 0.0832889
May 31 16:31:04.691324 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-eb6f874f-c2af-4277-99b2-c901d3f33e5b req-7f55554a-a4a5-4c81-acfa-47ee995792fe tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0722952
May 31 16:31:04.722470 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-ddfdca13-e08b-4bac-9f08-446048ea64c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f142710e3d0>, [{'id': '9e698298-b838-4dbb-939c-c84fb0148003', 'name': 'tempest-TestShelveInstance-844578684-router', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:05Z', 'updated_at': '2021-05-31T16:26:11Z', 'revision_number': 4, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'gw_port': {'id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:06:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_gateway', 'standard_attr_id': 550, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:07Z', 'updated_at': '2021-05-31T16:26:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '7fc65e68-76ee-48bf-8bb1-c3e5453fb94c', 'name': '', 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'mac_address': 'fa:16:3e:c5:53:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_interface', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '20f6caad-2e13-4108-af8f-f9c2336ccde2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:10Z', 'updated_at': '2021-05-31T16:26:16Z', 'revision_number': 5, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'subnets': [{'id': '20f6caad-2e13-4108-af8f-f9c2336ccde2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:31:04.727911 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ddfdca13-e08b-4bac-9f08-446048ea64c0 None None] Checking router: 9e698298-b838-4dbb-939c-c84fb0148003 for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:31:04.739316 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ddfdca13-e08b-4bac-9f08-446048ea64c0 None None] Routers {'9e698298-b838-4dbb-939c-c84fb0148003'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:31:04.740020 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-ddfdca13-e08b-4bac-9f08-446048ea64c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f142710e3d0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:30:38Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['9e698298-b838-4dbb-939c-c84fb0148003'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:31:04.791000 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7281214a-bb57-4476-96af-d0ad9797598f req-51c8c4b8-7e35-4b6a-86ef-85827cf06073 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:31:04.792565 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7281214a-bb57-4476-96af-d0ad9797598f req-51c8c4b8-7e35-4b6a-86ef-85827cf06073 service neutron] 10.222.0.63 "GET /v2.0/ports?network_id=0e202b3d-d60d-481f-bf3a-e31943668c98&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1082926
May 31 16:31:04.955960 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7281214a-bb57-4476-96af-d0ad9797598f req-682566dc-e459-48d0-8926-bde058523103 service neutron] 10.222.0.63 "GET /v2.0/networks/0e202b3d-d60d-481f-bf3a-e31943668c98?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1540830
May 31 16:31:04.966601 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-ddfdca13-e08b-4bac-9f08-446048ea64c0 None None] Set router 9e698298-b838-4dbb-939c-c84fb0148003 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:31:04.972564 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 39896) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:31:05.067901 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-afe61d19-ea02-4514-9614-f49d7f5c5586 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:05.136884 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-7281214a-bb57-4476-96af-d0ad9797598f req-ff0f74df-13fc-4b57-85c2-c37d41a6670a service neutron] 10.222.0.63 "GET /v2.0/networks/0e202b3d-d60d-481f-bf3a-e31943668c98?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1735277
May 31 16:31:05.162448 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3150c894-663a-464e-bd2b-f21d90fc70d5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:05.179596 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-3150c894-663a-464e-bd2b-f21d90fc70d5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 31 16:31:05.185312 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-3150c894-663a-464e-bd2b-f21d90fc70d5 admin admin] Usage tracker for resource:security_group_rule and tenant:d72adf8652504768a90237149610613d is out of sync, need to count used quota {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 31 16:31:05.188358 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.quota.resource [None req-3150c894-663a-464e-bd2b-f21d90fc70d5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91764) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 31 16:31:05.197736 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.db.quota.driver [None req-3150c894-663a-464e-bd2b-f21d90fc70d5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91764) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 31 16:31:05.307071 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3150c894-663a-464e-bd2b-f21d90fc70d5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:05.311634 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-3150c894-663a-464e-bd2b-f21d90fc70d5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_create {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:05.320378 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-3cde4d03-ce6a-4de5-8aaf-b86d1f6a9b04 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:05.370049 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-3150c894-663a-464e-bd2b-f21d90fc70d5 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=d72adf8652504768a90237149610613d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3939528
May 31 16:31:05.370049 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3150c894-663a-464e-bd2b-f21d90fc70d5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cb701a53-73d2-4567-8d9f-f0320abdd001,revision_number=1']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:05.370409 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 39902) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:31:05.374471 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-3150c894-663a-464e-bd2b-f21d90fc70d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:05.406665 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-ddfdca13-e08b-4bac-9f08-446048ea64c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f142710e3d0>, [{'id': '9e698298-b838-4dbb-939c-c84fb0148003', 'name': 'tempest-TestShelveInstance-844578684-router', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:05Z', 'updated_at': '2021-05-31T16:26:11Z', 'revision_number': 4, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'gw_port': {'id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:06:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_gateway', 'standard_attr_id': 550, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:07Z', 'updated_at': '2021-05-31T16:26:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '7fc65e68-76ee-48bf-8bb1-c3e5453fb94c', 'name': '', 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'mac_address': 'fa:16:3e:c5:53:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_interface', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '20f6caad-2e13-4108-af8f-f9c2336ccde2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:10Z', 'updated_at': '2021-05-31T16:26:16Z', 'revision_number': 5, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'subnets': [{'id': '20f6caad-2e13-4108-af8f-f9c2336ccde2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:31:05.411440 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ddfdca13-e08b-4bac-9f08-446048ea64c0 None None] The sync data for ids ['9e698298-b838-4dbb-939c-c84fb0148003'] in dv-cinder-793814-1-iscsi is: [{'id': '9e698298-b838-4dbb-939c-c84fb0148003', 'name': 'tempest-TestShelveInstance-844578684-router', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:05Z', 'updated_at': '2021-05-31T16:26:11Z', 'revision_number': 4, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'gw_port': {'id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:06:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_gateway', 'standard_attr_id': 550, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:07Z', 'updated_at': '2021-05-31T16:26:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi', '_interfaces': [{'id': '7fc65e68-76ee-48bf-8bb1-c3e5453fb94c', 'name': '', 'network_id': '0e202b3d-d60d-481f-bf3a-e31943668c98', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'mac_address': 'fa:16:3e:c5:53:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_interface', 'standard_attr_id': 551, 'fixed_ips': [{'subnet_id': '20f6caad-2e13-4108-af8f-f9c2336ccde2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:10Z', 'updated_at': '2021-05-31T16:26:16Z', 'revision_number': 5, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'subnets': [{'id': '20f6caad-2e13-4108-af8f-f9c2336ccde2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:31:05.452063 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-70b372d5-5ec7-4cc2-be44-5440d16ab0cc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:05.480266 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-70b372d5-5ec7-4cc2-be44-5440d16ab0cc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:05.544807 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-70b372d5-5ec7-4cc2-be44-5440d16ab0cc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:05.548846 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-bd88745a-be22-4e4a-b501-67c92717cb2d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:05.569072 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70b372d5-5ec7-4cc2-be44-5440d16ab0cc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cb701a53-73d2-4567-8d9f-f0320abdd001,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:05.571753 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-70b372d5-5ec7-4cc2-be44-5440d16ab0cc admin admin] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:05.572802 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-70b372d5-5ec7-4cc2-be44-5440d16ab0cc admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/cb701a53-73d2-4567-8d9f-f0320abdd001 HTTP/1.1" status: 204  len: 168 time: 0.2014821
May 31 16:31:05.573826 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-70b372d5-5ec7-4cc2-be44-5440d16ab0cc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:05.695186 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8b9ee79-c5d7-4664-adc4-c9eae4d6b91c None None] New status for floating IP cb7b2aba-d9dd-40bd-a8db-2affe7258aae: DOWN {{(pid=91766) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 31 16:31:05.944421 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42c62567-0cca-49b1-85ea-4dda72db3dbe req-536e1972-7d56-4611-a660-6daa00127340 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91764) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:31:05.946189 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-42c62567-0cca-49b1-85ea-4dda72db3dbe req-536e1972-7d56-4611-a660-6daa00127340 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.1061018
May 31 16:31:05.994227 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-42c62567-0cca-49b1-85ea-4dda72db3dbe req-affb3809-1968-46e6-b914-5dfabdeff0dc tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/security-groups?id=98f3ba1c-e634-454a-bd75-897eb9d73543&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0421793
May 31 16:31:06.092026 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2c1bf15-9a65-42c7-80ed-d154a748efe7 req-350b8a9a-295a-4e79-9459-781a24e8df7b tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91763) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 31 16:31:06.092784 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-d2c1bf15-9a65-42c7-80ed-d154a748efe7 req-350b8a9a-295a-4e79-9459-781a24e8df7b tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Synchronizing usage tracker for tenant:ff0bbba58394409987a388bb38868b4e on resource:port {{(pid=91763) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 31 16:31:06.110075 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.quota.resource [req-d2c1bf15-9a65-42c7-80ed-d154a748efe7 req-350b8a9a-295a-4e79-9459-781a24e8df7b tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Unset dirty status for tenant:ff0bbba58394409987a388bb38868b4e on resource:port {{(pid=91763) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 31 16:31:06.111154 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-d2c1bf15-9a65-42c7-80ed-d154a748efe7 req-350b8a9a-295a-4e79-9459-781a24e8df7b tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.63 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 946 time: 0.1011372
May 31 16:31:06.251751 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-d2c1bf15-9a65-42c7-80ed-d154a748efe7 req-8297c92b-f614-4607-975e-16e8d65d4e03 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Deleting port e42a29cb-c29c-41f8-9cfb-6379c167a596 {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:31:06.252173 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-d2c1bf15-9a65-42c7-80ed-d154a748efe7 req-8297c92b-f614-4607-975e-16e8d65d4e03 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:06.488321 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [req-d2c1bf15-9a65-42c7-80ed-d154a748efe7 req-8297c92b-f614-4607-975e-16e8d65d4e03 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] For port e42a29cb-c29c-41f8-9cfb-6379c167a596, host hv-cinder-79381, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79381',level=0,port_id=e42a29cb-c29c-41f8-9cfb-6379c167a596,segment=NetworkSegment(1e70bee6-dfc7-4037-8e59-6c6e25de8649),segment_id=1e70bee6-dfc7-4037-8e59-6c6e25de8649)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:31:06.488687 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-d2c1bf15-9a65-42c7-80ed-d154a748efe7 req-8297c92b-f614-4607-975e-16e8d65d4e03 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:06.619775 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [req-d2c1bf15-9a65-42c7-80ed-d154a748efe7 req-8297c92b-f614-4607-975e-16e8d65d4e03 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Calling delete_port for e42a29cb-c29c-41f8-9cfb-6379c167a596 owned by compute:nova {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:31:06.733897 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-d2c1bf15-9a65-42c7-80ed-d154a748efe7 req-8297c92b-f614-4607-975e-16e8d65d4e03 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:06.739960 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-6e08d9ce-5893-41e4-a3bf-bb77e8485052 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:06.789583 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8297c92b-f614-4607-975e-16e8d65d4e03 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Pushing event deleted for resources: {'Port': ['ID=e42a29cb-c29c-41f8-9cfb-6379c167a596,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:06.792679 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-8297c92b-f614-4607-975e-16e8d65d4e03 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:06.865763 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [req-d2c1bf15-9a65-42c7-80ed-d154a748efe7 req-8297c92b-f614-4607-975e-16e8d65d4e03 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] No DVR routers for this DVR port e42a29cb-c29c-41f8-9cfb-6379c167a596 on host hv-cinder-79381 {{(pid=91763) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:31:06.868276 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [req-d2c1bf15-9a65-42c7-80ed-d154a748efe7 req-8297c92b-f614-4607-975e-16e8d65d4e03 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-63741'] for port, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:06.871950 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd9e580af-3588-40d6-9e2a-60c321af3d1e', 'name': 'network-vif-deleted', 'tag': 'e42a29cb-c29c-41f8-9cfb-6379c167a596'}] {{(pid=91763) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 31 16:31:06.874240 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1cfc87f91788b1bcd0262be4b069fe8b6313987bc3eff007804987d25686fb1c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-968975c1-aa5f-4add-8192-5745289f8a8d" -d '{"events": [{"server_uuid": "d9e580af-3588-40d6-9e2a-60c321af3d1e", "name": "network-vif-deleted", "tag": "e42a29cb-c29c-41f8-9cfb-6379c167a596"}]}' {{(pid=91763) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
May 31 16:31:06.889902 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [req-d2c1bf15-9a65-42c7-80ed-d154a748efe7 req-8297c92b-f614-4607-975e-16e8d65d4e03 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.63 "DELETE /v2.0/ports/e42a29cb-c29c-41f8-9cfb-6379c167a596 HTTP/1.1" status: 204  len: 173 time: 0.7734110
May 31 16:31:06.923821 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Mon, 31 May 2021 16:31:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9827bb14-2cd5-48a2-80a7-96e2a8d05a8c x-openstack-request-id: req-9827bb14-2cd5-48a2-80a7-96e2a8d05a8c {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
May 31 16:31:06.924218 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d9e580af-3588-40d6-9e2a-60c321af3d1e", "name": "network-vif-deleted", "tag": "e42a29cb-c29c-41f8-9cfb-6379c167a596", "status": "completed", "code": 200}]} {{(pid=91763) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
May 31 16:31:06.924566 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-9827bb14-2cd5-48a2-80a7-96e2a8d05a8c {{(pid=91763) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
May 31 16:31:06.925032 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd9e580af-3588-40d6-9e2a-60c321af3d1e', 'name': 'network-vif-deleted', 'tag': 'e42a29cb-c29c-41f8-9cfb-6379c167a596', 'status': 'completed', 'code': 200}
May 31 16:31:07.151025 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [req-a1562791-f0a2-426e-ab35-39dc0aedf4e2 req-0392f135-9cbb-45ac-b7f6-84052750f65b tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "GET /v2.0/ports?device_id=d9e580af-3588-40d6-9e2a-60c321af3d1e HTTP/1.1" status: 200  len: 210 time: 0.0472679
May 31 16:31:07.912654 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:08.243568 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-57ac1bc1-6edc-4e57-91ed-7f54ae996d9a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:08.257202 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 39916) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:31:08.340043 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-f68d03a4-774f-4011-9a03-1a743eb4b5a6 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:08.370744 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-f68d03a4-774f-4011-9a03-1a743eb4b5a6 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:08.439327 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-f68d03a4-774f-4011-9a03-1a743eb4b5a6 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:08.445896 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-55e8ea09-4609-489f-83dd-400b30fd3517 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:08.463459 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f68d03a4-774f-4011-9a03-1a743eb4b5a6 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=98f3ba1c-e634-454a-bd75-897eb9d73543,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:08.466054 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-f68d03a4-774f-4011-9a03-1a743eb4b5a6 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:08.468619 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-f68d03a4-774f-4011-9a03-1a743eb4b5a6 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] Notify callbacks [] for security_group, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:08.469784 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-f68d03a4-774f-4011-9a03-1a743eb4b5a6 tempest-TestShelveInstance-1601545846 tempest-TestShelveInstance-1601545846-project] 10.222.0.43 "DELETE /v2.0/security-groups/98f3ba1c-e634-454a-bd75-897eb9d73543 HTTP/1.1" status: 204  len: 168 time: 0.2112827
May 31 16:31:08.532293 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 39922) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:31:09.191802 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:09.244243 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-15924c5c-7c43-4592-8bb9-61b84630a41e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-16627919'] for router_interface, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:09.756960 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-15924c5c-7c43-4592-8bb9-61b84630a41e admin admin] Deleting port 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c {{(pid=91764) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:31:09.757662 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-15924c5c-7c43-4592-8bb9-61b84630a41e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:09.880597 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.db [None req-15924c5c-7c43-4592-8bb9-61b84630a41e admin admin] For port 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=7fc65e68-76ee-48bf-8bb1-c3e5453fb94c,segment=NetworkSegment(1e70bee6-dfc7-4037-8e59-6c6e25de8649),segment_id=1e70bee6-dfc7-4037-8e59-6c6e25de8649)] {{(pid=91764) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:31:09.880980 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-15924c5c-7c43-4592-8bb9-61b84630a41e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:10.003171 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.plugins.ml2.plugin [None req-15924c5c-7c43-4592-8bb9-61b84630a41e admin admin] Calling delete_port for 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c owned by network:router_interface {{(pid=91764) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:31:10.153771 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-15924c5c-7c43-4592-8bb9-61b84630a41e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14905809'] for port, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:10.157330 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-0bd6fef5-6cda-41c7-8908-95cec6b2ea78 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:10.203047 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15924c5c-7c43-4592-8bb9-61b84630a41e admin admin] Pushing event deleted for resources: {'Port': ['ID=7fc65e68-76ee-48bf-8bb1-c3e5453fb94c,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:10.209592 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-15924c5c-7c43-4592-8bb9-61b84630a41e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:10.470264 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-15924c5c-7c43-4592-8bb9-61b84630a41e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-16317375', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-16625247'] for router_interface, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:10.802633 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device e42a29cb-c29c-41f8-9cfb-6379c167a596 no longer exists at agent hyperv_hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:31:10.841065 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] No Port match for: e42a29cb-c29c-41f8-9cfb-6379c167a596 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:31:10.841745 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Device e42a29cb-c29c-41f8-9cfb-6379c167a596 not bound to the agent host hv-cinder-79381 {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:31:10.902055 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:10.935810 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-15924c5c-7c43-4592-8bb9-61b84630a41e admin admin] Router 9e698298-b838-4dbb-939c-c84fb0148003 has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91764) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:31:11.117205 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-15924c5c-7c43-4592-8bb9-61b84630a41e admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91764) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:31:11.125506 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6ecfe05-0211-4ba6-becc-46178f1cb947 None None] Sync routers for ids ['9e698298-b838-4dbb-939c-c84fb0148003'] in dv-cinder-793814-1-iscsi {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:31:11.136121 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6ecfe05-0211-4ba6-becc-46178f1cb947 None None] Routers {'9e698298-b838-4dbb-939c-c84fb0148003'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:31:11.136733 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-d6ecfe05-0211-4ba6-becc-46178f1cb947 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f142641dee0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:31:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['9e698298-b838-4dbb-939c-c84fb0148003'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:31:11.138278 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-15924c5c-7c43-4592-8bb9-61b84630a41e admin admin] 10.222.0.43 "PUT /v2.0/routers/9e698298-b838-4dbb-939c-c84fb0148003/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6045227
May 31 16:31:11.140792 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 39928) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:31:11.311431 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-d6ecfe05-0211-4ba6-becc-46178f1cb947 None None] Set router 9e698298-b838-4dbb-939c-c84fb0148003 gateway port host: dv-cinder-793814-1-iscsi {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:31:11.318818 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fe90a69d-f3e6-4ab9-bc06-844157cb9cfd admin admin] Notify callbacks [] for router, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:11.492127 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fe90a69d-f3e6-4ab9-bc06-844157cb9cfd admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:11.566961 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-fe90a69d-f3e6-4ab9-bc06-844157cb9cfd admin admin] Deleting port dc058e78-0721-4760-9e77-06b3f85979b7 {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:31:11.567314 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fe90a69d-f3e6-4ab9-bc06-844157cb9cfd admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:11.591491 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-d6ecfe05-0211-4ba6-becc-46178f1cb947 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f142641dee0>, [{'id': '9e698298-b838-4dbb-939c-c84fb0148003', 'name': 'tempest-TestShelveInstance-844578684-router', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74'}], 'enable_snat': True}, 'gw_port_id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:05Z', 'updated_at': '2021-05-31T16:31:10Z', 'revision_number': 5, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'gw_port': {'id': 'dc058e78-0721-4760-9e77-06b3f85979b7', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:06:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e698298-b838-4dbb-939c-c84fb0148003', 'device_owner': 'network:router_gateway', 'standard_attr_id': 550, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:07Z', 'updated_at': '2021-05-31T16:26:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:31:11.595322 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6ecfe05-0211-4ba6-becc-46178f1cb947 None None] Checking router: 9e698298-b838-4dbb-939c-c84fb0148003 for host: dv-cinder-793814-1-iscsi {{(pid=91765) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:31:11.604236 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6ecfe05-0211-4ba6-becc-46178f1cb947 None None] Routers {'9e698298-b838-4dbb-939c-c84fb0148003'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91765) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:31:11.604846 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-d6ecfe05-0211-4ba6-becc-46178f1cb947 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f142641dee0>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:31:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['9e698298-b838-4dbb-939c-c84fb0148003'], 'active': True} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:31:11.688443 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [None req-fe90a69d-f3e6-4ab9-bc06-844157cb9cfd admin admin] For port dc058e78-0721-4760-9e77-06b3f85979b7, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=dc058e78-0721-4760-9e77-06b3f85979b7,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:31:11.688896 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fe90a69d-f3e6-4ab9-bc06-844157cb9cfd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:11.757814 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvr_db [None req-d6ecfe05-0211-4ba6-becc-46178f1cb947 None None] Set router 9e698298-b838-4dbb-939c-c84fb0148003 gateway port host: None {{(pid=91765) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:31:11.812724 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-fe90a69d-f3e6-4ab9-bc06-844157cb9cfd admin admin] Calling delete_port for dc058e78-0721-4760-9e77-06b3f85979b7 owned by network:router_gateway {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:31:11.865698 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_hamode_db [None req-d6ecfe05-0211-4ba6-becc-46178f1cb947 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f142641dee0>, [{'id': '9e698298-b838-4dbb-939c-c84fb0148003', 'name': 'tempest-TestShelveInstance-844578684-router', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:05Z', 'updated_at': '2021-05-31T16:31:11Z', 'revision_number': 6, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'gw_port_host': None}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91765) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:31:11.869872 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6ecfe05-0211-4ba6-becc-46178f1cb947 None None] The sync data for ids ['9e698298-b838-4dbb-939c-c84fb0148003'] in dv-cinder-793814-1-iscsi is: [{'id': '9e698298-b838-4dbb-939c-c84fb0148003', 'name': 'tempest-TestShelveInstance-844578684-router', 'tenant_id': 'ff0bbba58394409987a388bb38868b4e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:05Z', 'updated_at': '2021-05-31T16:31:11Z', 'revision_number': 6, 'project_id': 'ff0bbba58394409987a388bb38868b4e', 'gw_port_host': None}] {{(pid=91765) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:31:11.969909 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fe90a69d-f3e6-4ab9-bc06-844157cb9cfd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:11.973709 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-6961478e-4882-41c9-b6f1-7db11bfadfe2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:12.113631 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe90a69d-f3e6-4ab9-bc06-844157cb9cfd admin admin] Pushing event deleted for resources: {'Port': ['ID=dc058e78-0721-4760-9e77-06b3f85979b7,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:12.116592 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-fe90a69d-f3e6-4ab9-bc06-844157cb9cfd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:12.206943 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fe90a69d-f3e6-4ab9-bc06-844157cb9cfd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-16621778'] for router_gateway, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:12.378029 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fe90a69d-f3e6-4ab9-bc06-844157cb9cfd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-16623711', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-683'] for router, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:12.380129 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fe90a69d-f3e6-4ab9-bc06-844157cb9cfd admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:12.405867 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fe90a69d-f3e6-4ab9-bc06-844157cb9cfd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-16623971'] for router, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:12.406459 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fe90a69d-f3e6-4ab9-bc06-844157cb9cfd admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9e698298-b838-4dbb-939c-c84fb0148003 {{(pid=91763) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 31 16:31:12.419570 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-fe90a69d-f3e6-4ab9-bc06-844157cb9cfd admin admin] Notify callbacks [] for router, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:12.420679 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-fe90a69d-f3e6-4ab9-bc06-844157cb9cfd admin admin] 10.222.0.43 "DELETE /v2.0/routers/9e698298-b838-4dbb-939c-c84fb0148003 HTTP/1.1" status: 204  len: 168 time: 1.2788689
May 31 16:31:12.423152 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 39932) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:31:12.482212 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_v2 [None req-05b082f7-9496-4410-a8b9-a1d8f13672ce admin admin] Deleting subnet 20f6caad-2e13-4108-af8f-f9c2336ccde2 {{(pid=91763) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 31 16:31:12.485110 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-05b082f7-9496-4410-a8b9-a1d8f13672ce admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:12.536220 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-05b082f7-9496-4410-a8b9-a1d8f13672ce admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-15104879'] for subnet, precommit_delete_associations {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:12.620134 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-05b082f7-9496-4410-a8b9-a1d8f13672ce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-975336'] for subnet, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:12.633848 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:31:12.668449 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:31:12.669125 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 7fc65e68-76ee-48bf-8bb1-c3e5453fb94c not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:31:12.669812 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device dc058e78-0721-4760-9e77-06b3f85979b7 no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:31:12.704161 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: dc058e78-0721-4760-9e77-06b3f85979b7 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:31:12.704522 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device dc058e78-0721-4760-9e77-06b3f85979b7 not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:31:12.886039 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-05b082f7-9496-4410-a8b9-a1d8f13672ce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-978269', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14336704', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-13992643'] for subnet, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:12.890652 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:12.925369 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05b082f7-9496-4410-a8b9-a1d8f13672ce admin admin] Pushing event deleted for resources: {'Subnet': ['ID=20f6caad-2e13-4108-af8f-f9c2336ccde2,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:12.927334 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-05b082f7-9496-4410-a8b9-a1d8f13672ce admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:12.929853 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-05b082f7-9496-4410-a8b9-a1d8f13672ce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:12.931362 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c78fc28f-42d0-4e66-a139-8f77cde9203b None None] Network 0e202b3d-d60d-481f-bf3a-e31943668c98 requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:31:12.935182 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-05b082f7-9496-4410-a8b9-a1d8f13672ce admin admin] 10.222.0.43 "DELETE /v2.0/subnets/20f6caad-2e13-4108-af8f-f9c2336ccde2 HTTP/1.1" status: 204  len: 168 time: 0.5103791
May 31 16:31:12.936308 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 39936) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:31:13.049011 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-525980'] for network, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:13.123489 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] Deleting port 8bb259a5-2a36-4eb3-9fe6-00460cc552fe {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:31:13.123839 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:13.188673 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54969a6e-5375-4ef2-b4b2-c598d27205a6 None None] DHCP port deletion for 0e202b3d-d60d-481f-bf3a-e31943668c98 request from dv-cinder-793814-1-iscsi {{(pid=91765) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 31 16:31:13.226793 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] For port 8bb259a5-2a36-4eb3-9fe6-00460cc552fe, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=8bb259a5-2a36-4eb3-9fe6-00460cc552fe,segment=NetworkSegment(1e70bee6-dfc7-4037-8e59-6c6e25de8649),segment_id=1e70bee6-dfc7-4037-8e59-6c6e25de8649)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:31:13.227414 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:13.254653 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-54969a6e-5375-4ef2-b4b2-c598d27205a6 None None] Deleting port 8bb259a5-2a36-4eb3-9fe6-00460cc552fe {{(pid=91765) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:31:13.255026 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-54969a6e-5375-4ef2-b4b2-c598d27205a6 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:13.354665 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] Calling delete_port for 8bb259a5-2a36-4eb3-9fe6-00460cc552fe owned by network:dhcp {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:31:13.394797 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-54969a6e-5375-4ef2-b4b2-c598d27205a6 None None] For port 8bb259a5-2a36-4eb3-9fe6-00460cc552fe, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=8bb259a5-2a36-4eb3-9fe6-00460cc552fe,segment=NetworkSegment(1e70bee6-dfc7-4037-8e59-6c6e25de8649),segment_id=1e70bee6-dfc7-4037-8e59-6c6e25de8649)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:31:13.395111 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-54969a6e-5375-4ef2-b4b2-c598d27205a6 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:13.402048 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:13.405930 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-478001ac-2065-4d50-adbe-41b027f5b292 tempest-AttachVolumeTestJSON-1917820542 tempest-AttachVolumeTestJSON-1917820542-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:13.453279 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] Pushing event deleted for resources: {'Port': ['ID=8bb259a5-2a36-4eb3-9fe6-00460cc552fe,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:13.457464 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:13.458268 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] No DVR routers for this DVR port 8bb259a5-2a36-4eb3-9fe6-00460cc552fe on host dv-cinder-793814-1-iscsi {{(pid=91763) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:31:13.522428 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-54969a6e-5375-4ef2-b4b2-c598d27205a6 None None] Calling delete_port for 8bb259a5-2a36-4eb3-9fe6-00460cc552fe owned by network:dhcp {{(pid=91765) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:31:13.566670 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-54969a6e-5375-4ef2-b4b2-c598d27205a6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907'] for port, after_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:13.570457 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-9f728e85-a429-4786-a452-096b7c515647 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:13.614462 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54969a6e-5375-4ef2-b4b2-c598d27205a6 None None] Pushing event deleted for resources: {'Port': ['ID=8bb259a5-2a36-4eb3-9fe6-00460cc552fe,revision_number=None']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:13.617446 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-54969a6e-5375-4ef2-b4b2-c598d27205a6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:13.618284 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54969a6e-5375-4ef2-b4b2-c598d27205a6 None None] No DVR routers for this DVR port 8bb259a5-2a36-4eb3-9fe6-00460cc552fe on host dv-cinder-793814-1-iscsi {{(pid=91765) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:31:13.662499 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-988775', 'neutron.services.segments.db._delete_segments_for_network-8732784586204'] for network, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:13.675395 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f14255c48b0>,) {'filters': {'network_id': ['0e202b3d-d60d-481f-bf3a-e31943668c98']}} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:31:13.687234 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f14255c48b0>, '1e70bee6-dfc7-4037-8e59-6c6e25de8649') {'for_net_delete': True} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:31:13.687536 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f14255c48b0>, '1e70bee6-dfc7-4037-8e59-6c6e25de8649') {} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:31:13.699435 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732784599197', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15104868'] for segment, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:13.716168 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:13.722438 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] Releasing vlan 823 on physical network physnet1 to pool {{(pid=91763) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 31 16:31:13.722829 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14337126'] for segment, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]: Traceback (most recent call last):
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:     timer()
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:     cb(*args, **kw)
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:     return func(*args, **kwargs)
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:     self._notify()
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:     self.callback(batched_events)
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:     event.method(event)
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:     aggregate_uuid = self.p_client.list_aggregates(
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:     return f(self, *a, **k)
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self._get(url).json()
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self.request(url, 'GET', **kwargs)
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:     base_url = self.get_endpoint(auth, allow=allow,
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 31 16:31:13.735747 dv-cinder-793814-1-iscsi neutron-server[91763]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 31 16:31:13.813116 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16621775'] for network, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:13.817093 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-b900b1a7-9767-4128-b508-2e463e5bc7a4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:13.829723 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:13.841822 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] Pushing event deleted for resources: {'Network': ['ID=0e202b3d-d60d-481f-bf3a-e31943668c98,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:13.846057 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:13.847550 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-ca2201f0-37c6-4100-a02c-72c35eaf29e1 admin admin] 10.222.0.43 "DELETE /v2.0/networks/0e202b3d-d60d-481f-bf3a-e31943668c98 HTTP/1.1" status: 204  len: 168 time: 0.9103565
May 31 16:31:13.850407 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 39940) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:31:14.381207 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-351436c5-cbd7-410c-8301-ec45865510ca admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-16627919'] for router_interface, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:14.500482 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 8bb259a5-2a36-4eb3-9fe6-00460cc552fe no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:31:14.535238 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: 8bb259a5-2a36-4eb3-9fe6-00460cc552fe {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:31:14.535583 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 8bb259a5-2a36-4eb3-9fe6-00460cc552fe not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:31:14.799315 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-351436c5-cbd7-410c-8301-ec45865510ca admin admin] Deleting port 58810335-9a49-4d92-a985-50523399ef7d {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:31:14.799648 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-351436c5-cbd7-410c-8301-ec45865510ca admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:14.920256 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [None req-351436c5-cbd7-410c-8301-ec45865510ca admin admin] For port 58810335-9a49-4d92-a985-50523399ef7d, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=58810335-9a49-4d92-a985-50523399ef7d,segment=NetworkSegment(55db7c87-2a89-44db-9f17-28d7a4f933d2),segment_id=55db7c87-2a89-44db-9f17-28d7a4f933d2)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:31:14.920646 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-351436c5-cbd7-410c-8301-ec45865510ca admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:15.136790 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-351436c5-cbd7-410c-8301-ec45865510ca admin admin] Calling delete_port for 58810335-9a49-4d92-a985-50523399ef7d owned by network:router_interface {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:31:15.280507 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-351436c5-cbd7-410c-8301-ec45865510ca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:15.284630 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-39c25732-6d9b-49ea-915c-aadaf3488000 tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:15.327484 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-351436c5-cbd7-410c-8301-ec45865510ca admin admin] Pushing event deleted for resources: {'Port': ['ID=58810335-9a49-4d92-a985-50523399ef7d,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:15.330701 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-351436c5-cbd7-410c-8301-ec45865510ca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:15.596436 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-351436c5-cbd7-410c-8301-ec45865510ca admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-16317375', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-16625247'] for router_interface, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:15.950772 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-351436c5-cbd7-410c-8301-ec45865510ca admin admin] Router a9a6ab5f-4296-4103-9658-5468573f9ddb has already been hosted by L3 agent a42e4551-1ef1-4c85-ae05-060ea4401b3e {{(pid=91763) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 31 16:31:16.131858 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-351436c5-cbd7-410c-8301-ec45865510ca admin admin] Notify agent at l3_agent.dv-cinder-793814-1-iscsi the message routers_updated {{(pid=91763) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 31 16:31:16.144292 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0234927-b94b-41c3-b467-51cbca49704e None None] Sync routers for ids ['a9a6ab5f-4296-4103-9658-5468573f9ddb'] in dv-cinder-793814-1-iscsi {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 31 16:31:16.149992 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-351436c5-cbd7-410c-8301-ec45865510ca admin admin] 10.222.0.43 "PUT /v2.0/routers/a9a6ab5f-4296-4103-9658-5468573f9ddb/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.2985280
May 31 16:31:16.152408 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 39944) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:31:16.158018 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0234927-b94b-41c3-b467-51cbca49704e None None] Routers {'a9a6ab5f-4296-4103-9658-5468573f9ddb'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:31:16.159300 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-e0234927-b94b-41c3-b467-51cbca49704e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426b68d00>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:31:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['a9a6ab5f-4296-4103-9658-5468573f9ddb'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:31:16.330723 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0ff6c88c-7a05-4e0e-b8fa-d22b1fc4e3a6 admin admin] Notify callbacks [] for router, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:16.375149 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-e0234927-b94b-41c3-b467-51cbca49704e None None] Set router a9a6ab5f-4296-4103-9658-5468573f9ddb gateway port host: dv-cinder-793814-1-iscsi {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:31:16.614983 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0ff6c88c-7a05-4e0e-b8fa-d22b1fc4e3a6 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:16.669490 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-e0234927-b94b-41c3-b467-51cbca49704e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426b68d00>, [{'id': 'a9a6ab5f-4296-4103-9658-5468573f9ddb', 'name': 'tempest-TestShelveInstance-337520229-router', 'tenant_id': 'aaf741cd215644308245542578883a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'external_fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.158'}], 'enable_snat': True}, 'gw_port_id': '6edd72e2-8a92-4c90-8270-1312d8c8f983', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:14Z', 'updated_at': '2021-05-31T16:31:15Z', 'revision_number': 5, 'project_id': 'aaf741cd215644308245542578883a8a', 'gw_port': {'id': '6edd72e2-8a92-4c90-8270-1312d8c8f983', 'name': '', 'network_id': '00ddbf5c-659c-4d7c-acb2-a85c18c6bc1c', 'tenant_id': '', 'mac_address': 'fa:16:3e:8a:59:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9a6ab5f-4296-4103-9658-5468573f9ddb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 562, 'fixed_ips': [{'subnet_id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'ip_address': '172.27.0.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793814-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-31T16:26:15Z', 'updated_at': '2021-05-31T16:26:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '96709d85-d0fe-4cf8-b232-eaf6b143ebe6', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793814-1-iscsi'}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:31:16.673281 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0234927-b94b-41c3-b467-51cbca49704e None None] Checking router: a9a6ab5f-4296-4103-9658-5468573f9ddb for host: dv-cinder-793814-1-iscsi {{(pid=91766) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 31 16:31:16.682033 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0234927-b94b-41c3-b467-51cbca49704e None None] Routers {'a9a6ab5f-4296-4103-9658-5468573f9ddb'} bound to L3 agent in host dv-cinder-793814-1-iscsi {{(pid=91766) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 31 16:31:16.682628 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-e0234927-b94b-41c3-b467-51cbca49704e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f1426b68d00>, 'dv-cinder-793814-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-31T16:12:08Z,description=<?>,heartbeat_timestamp=2021-05-31T16:31:08Z,host='dv-cinder-793814-1-iscsi',id=a42e4551-1ef1-4c85-ae05-060ea4401b3e,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-31T16:12:08Z,topic='l3_agent')) {'router_ids': ['a9a6ab5f-4296-4103-9658-5468573f9ddb'], 'active': True} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:31:16.686208 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-0ff6c88c-7a05-4e0e-b8fa-d22b1fc4e3a6 admin admin] Deleting port 6edd72e2-8a92-4c90-8270-1312d8c8f983 {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:31:16.686548 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0ff6c88c-7a05-4e0e-b8fa-d22b1fc4e3a6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:16.810805 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [None req-0ff6c88c-7a05-4e0e-b8fa-d22b1fc4e3a6 admin admin] For port 6edd72e2-8a92-4c90-8270-1312d8c8f983, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=6edd72e2-8a92-4c90-8270-1312d8c8f983,segment=NetworkSegment(2373ca36-2a20-452a-927f-d77f06588c5e),segment_id=2373ca36-2a20-452a-927f-d77f06588c5e)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:31:16.811196 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0ff6c88c-7a05-4e0e-b8fa-d22b1fc4e3a6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:16.837980 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_dvr_db [None req-e0234927-b94b-41c3-b467-51cbca49704e None None] Set router a9a6ab5f-4296-4103-9658-5468573f9ddb gateway port host: None {{(pid=91766) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 31 16:31:16.941323 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-0ff6c88c-7a05-4e0e-b8fa-d22b1fc4e3a6 admin admin] Calling delete_port for 6edd72e2-8a92-4c90-8270-1312d8c8f983 owned by network:router_gateway {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:31:16.947244 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.l3_hamode_db [None req-e0234927-b94b-41c3-b467-51cbca49704e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f1426b68d00>, [{'id': 'a9a6ab5f-4296-4103-9658-5468573f9ddb', 'name': 'tempest-TestShelveInstance-337520229-router', 'tenant_id': 'aaf741cd215644308245542578883a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:14Z', 'updated_at': '2021-05-31T16:31:16Z', 'revision_number': 6, 'project_id': 'aaf741cd215644308245542578883a8a', 'gw_port_host': None}], 'dv-cinder-793814-1-iscsi', False) {} {{(pid=91766) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:31:16.951973 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0234927-b94b-41c3-b467-51cbca49704e None None] The sync data for ids ['a9a6ab5f-4296-4103-9658-5468573f9ddb'] in dv-cinder-793814-1-iscsi is: [{'id': 'a9a6ab5f-4296-4103-9658-5468573f9ddb', 'name': 'tempest-TestShelveInstance-337520229-router', 'tenant_id': 'aaf741cd215644308245542578883a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-31T16:26:14Z', 'updated_at': '2021-05-31T16:31:16Z', 'revision_number': 6, 'project_id': 'aaf741cd215644308245542578883a8a', 'gw_port_host': None}] {{(pid=91766) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 31 16:31:17.084341 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0ff6c88c-7a05-4e0e-b8fa-d22b1fc4e3a6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:17.088810 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-196d4d8d-a951-4090-8381-fdacb1a10ebc tempest-AttachVolumeShelveTestJSON-1782695116 tempest-AttachVolumeShelveTestJSON-1782695116-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:17.134444 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ff6c88c-7a05-4e0e-b8fa-d22b1fc4e3a6 admin admin] Pushing event deleted for resources: {'Port': ['ID=6edd72e2-8a92-4c90-8270-1312d8c8f983,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:17.168595 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-0ff6c88c-7a05-4e0e-b8fa-d22b1fc4e3a6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:17.228221 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0ff6c88c-7a05-4e0e-b8fa-d22b1fc4e3a6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-16621778'] for router_gateway, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:17.406241 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0ff6c88c-7a05-4e0e-b8fa-d22b1fc4e3a6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-16623711', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-683'] for router, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:17.408584 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0ff6c88c-7a05-4e0e-b8fa-d22b1fc4e3a6 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:17.430616 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0ff6c88c-7a05-4e0e-b8fa-d22b1fc4e3a6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-16623971'] for router, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:17.431166 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0ff6c88c-7a05-4e0e-b8fa-d22b1fc4e3a6 admin admin] Fanout notify agent at l3_agent the message router_deleted on router a9a6ab5f-4296-4103-9658-5468573f9ddb {{(pid=91763) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 31 16:31:17.443542 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-0ff6c88c-7a05-4e0e-b8fa-d22b1fc4e3a6 admin admin] Notify callbacks [] for router, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:17.444643 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-0ff6c88c-7a05-4e0e-b8fa-d22b1fc4e3a6 admin admin] 10.222.0.43 "DELETE /v2.0/routers/a9a6ab5f-4296-4103-9658-5468573f9ddb HTTP/1.1" status: 204  len: 168 time: 1.2913182
May 31 16:31:17.447278 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 39948) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:31:17.506219 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.db_base_plugin_v2 [None req-5ab58e91-337f-468b-b2b5-46ed2afb28e6 admin admin] Deleting subnet 38eb0166-07db-4a38-bf20-2ae69f7dbb32 {{(pid=91763) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 31 16:31:17.509308 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5ab58e91-337f-468b-b2b5-46ed2afb28e6 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:17.559597 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5ab58e91-337f-468b-b2b5-46ed2afb28e6 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-15104879'] for subnet, precommit_delete_associations {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:17.638283 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5ab58e91-337f-468b-b2b5-46ed2afb28e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-975336'] for subnet, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:17.909028 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5ab58e91-337f-468b-b2b5-46ed2afb28e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-978269', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14336704', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-13992643'] for subnet, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:17.913294 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-2e6d90db-07f7-452c-8a01-13da0c5c7fec admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:17.948668 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ab58e91-337f-468b-b2b5-46ed2afb28e6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=38eb0166-07db-4a38-bf20-2ae69f7dbb32,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:17.951211 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-5ab58e91-337f-468b-b2b5-46ed2afb28e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:17.957190 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-5ab58e91-337f-468b-b2b5-46ed2afb28e6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for subnet, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:17.962025 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9fe9a57d-c6b1-4ce5-9263-0bebe3e6f87b None None] Network b51eb33b-7c79-46ba-9423-a0ce34433ebb requested from dv-cinder-793814-1-iscsi {{(pid=91765) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 31 16:31:17.964328 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-5ab58e91-337f-468b-b2b5-46ed2afb28e6 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/38eb0166-07db-4a38-bf20-2ae69f7dbb32 HTTP/1.1" status: 204  len: 168 time: 0.5161195
May 31 16:31:17.966867 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.wsgi [-] (91763) accepted ('10.222.0.43', 39952) {{(pid=91763) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:31:18.180096 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-525980'] for network, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:18.229184 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd208757-17a5-4b0f-b5fa-eda64892f7c2 None None] DHCP port deletion for b51eb33b-7c79-46ba-9423-a0ce34433ebb request from dv-cinder-793814-1-iscsi {{(pid=91765) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 31 16:31:18.255604 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] Deleting port 842aa924-305c-498f-aa53-f51584f13c78 {{(pid=91763) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:31:18.256046 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:18.294761 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-cd208757-17a5-4b0f-b5fa-eda64892f7c2 None None] Deleting port 842aa924-305c-498f-aa53-f51584f13c78 {{(pid=91765) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 31 16:31:18.295142 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-cd208757-17a5-4b0f-b5fa-eda64892f7c2 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732784443203'] for port, before_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:18.356887 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.db [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] For port 842aa924-305c-498f-aa53-f51584f13c78, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=842aa924-305c-498f-aa53-f51584f13c78,segment=NetworkSegment(55db7c87-2a89-44db-9f17-28d7a4f933d2),segment_id=55db7c87-2a89-44db-9f17-28d7a4f933d2)] {{(pid=91763) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:31:18.357274 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:18.394571 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.db [None req-cd208757-17a5-4b0f-b5fa-eda64892f7c2 None None] For port 842aa924-305c-498f-aa53-f51584f13c78, host dv-cinder-793814-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793814-1-iscsi',level=0,port_id=842aa924-305c-498f-aa53-f51584f13c78,segment=NetworkSegment(55db7c87-2a89-44db-9f17-28d7a4f933d2),segment_id=55db7c87-2a89-44db-9f17-28d7a4f933d2)] {{(pid=91765) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 31 16:31:18.394975 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-cd208757-17a5-4b0f-b5fa-eda64892f7c2 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16623134'] for port, precommit_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:18.497503 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.plugin [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] Calling delete_port for 842aa924-305c-498f-aa53-f51584f13c78 owned by network:dhcp {{(pid=91763) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:31:18.525953 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 842aa924-305c-498f-aa53-f51584f13c78 no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:31:18.546636 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14337075'] for port, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:18.551147 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-929529a8-bb5a-4347-9677-c9353b564e06 tempest-TestVolumeBootPattern-1832121430 tempest-TestVolumeBootPattern-1832121430-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:18.562689 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-cd208757-17a5-4b0f-b5fa-eda64892f7c2 None None] Calling delete_port for 842aa924-305c-498f-aa53-f51584f13c78 owned by network:dhcp {{(pid=91765) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 31 16:31:18.572214 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: 842aa924-305c-498f-aa53-f51584f13c78 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:31:18.572563 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 842aa924-305c-498f-aa53-f51584f13c78 not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:31:18.572981 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 6edd72e2-8a92-4c90-8270-1312d8c8f983 no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:31:18.592875 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] Pushing event deleted for resources: {'Port': ['ID=842aa924-305c-498f-aa53-f51584f13c78,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:18.596655 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:18.601025 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.db.l3_dvrscheduler_db [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] No DVR routers for this DVR port 842aa924-305c-498f-aa53-f51584f13c78 on host dv-cinder-793814-1-iscsi {{(pid=91763) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:31:18.609178 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: 6edd72e2-8a92-4c90-8270-1312d8c8f983 {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:31:18.609565 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 6edd72e2-8a92-4c90-8270-1312d8c8f983 not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:31:18.609983 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 58810335-9a49-4d92-a985-50523399ef7d no longer exists at agent ovs-agent-dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 31 16:31:18.644438 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.plugin [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] No Port match for: 58810335-9a49-4d92-a985-50523399ef7d {{(pid=91765) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 31 16:31:18.644792 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.plugins.ml2.rpc [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Device 58810335-9a49-4d92-a985-50523399ef7d not bound to the agent host dv-cinder-793814-1-iscsi {{(pid=91765) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 31 16:31:18.680516 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-cd208757-17a5-4b0f-b5fa-eda64892f7c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-640755', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-42865', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16317357', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732784445350', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732784061907'] for port, after_delete {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:18.684076 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-df43ce45-0b9f-4591-9a24-d07be2c25627 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:18.721923 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-988775', 'neutron.services.segments.db._delete_segments_for_network-8732784586204'] for network, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:18.728360 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd208757-17a5-4b0f-b5fa-eda64892f7c2 None None] Pushing event deleted for resources: {'Port': ['ID=842aa924-305c-498f-aa53-f51584f13c78,revision_number=None']} {{(pid=91765) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:18.731923 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG oslo_concurrency.lockutils [None req-cd208757-17a5-4b0f-b5fa-eda64892f7c2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91765) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:18.734872 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd208757-17a5-4b0f-b5fa-eda64892f7c2 None None] No DVR routers for this DVR port 842aa924-305c-498f-aa53-f51584f13c78 on host dv-cinder-793814-1-iscsi {{(pid=91765) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 31 16:31:18.736621 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f1426885580>,) {'filters': {'network_id': ['b51eb33b-7c79-46ba-9423-a0ce34433ebb']}} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:31:18.749955 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f1426885580>, '55db7c87-2a89-44db-9f17-28d7a4f933d2') {'for_net_delete': True} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:31:18.750260 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.services.segments.db [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f1426885580>, '55db7c87-2a89-44db-9f17-28d7a4f933d2') {} {{(pid=91763) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 31 16:31:18.762486 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732784599197', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15104868'] for segment, before_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:18.778692 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007'] for segment, precommit_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:18.786289 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] Releasing vlan 832 on physical network physnet1 to pool {{(pid=91763) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 31 16:31:18.786687 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-983007', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14337126'] for segment, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]: Traceback (most recent call last):
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:     timer()
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:     cb(*args, **kw)
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:     return func(*args, **kwargs)
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:     self._notify()
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:     self.callback(batched_events)
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:     event.method(event)
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:     aggregate_uuid = self.p_client.list_aggregates(
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:     return f(self, *a, **k)
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self._get(url).json()
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:     return self.request(url, 'GET', **kwargs)
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:     base_url = self.get_endpoint(auth, allow=allow,
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 31 16:31:18.800579 dv-cinder-793814-1-iscsi neutron-server[91763]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 31 16:31:18.879397 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16435295', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16317366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16621775'] for network, after_delete {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:18.882872 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-e5872f39-ccf8-42f6-aa75-b055f9fa85b2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:18.896030 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron_lib.callbacks.manager [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16317331'] for network, before_response {{(pid=91763) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:18.906022 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] Pushing event deleted for resources: {'Network': ['ID=b51eb33b-7c79-46ba-9423-a0ce34433ebb,revision_number=None']} {{(pid=91763) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:18.910792 dv-cinder-793814-1-iscsi neutron-server[91763]: DEBUG oslo_concurrency.lockutils [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:18.914216 dv-cinder-793814-1-iscsi neutron-server[91763]: INFO neutron.wsgi [None req-864c0b63-bf52-43bd-b2b5-c974e809b916 admin admin] 10.222.0.43 "DELETE /v2.0/networks/b51eb33b-7c79-46ba-9423-a0ce34433ebb HTTP/1.1" status: 204  len: 168 time: 0.9464352
May 31 16:31:19.030959 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 39958) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:31:19.081491 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-1753cec5-77eb-4b58-9926-b6dfb96ba34c admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=ff0bbba58394409987a388bb38868b4e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0492914
May 31 16:31:19.083946 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 39962) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:31:19.144686 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-cb511d91-de3b-4921-88aa-da95d196e37a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:19.170804 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-cb511d91-de3b-4921-88aa-da95d196e37a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:19.223014 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-cb511d91-de3b-4921-88aa-da95d196e37a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:19.226911 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-7175bb1a-4e36-450f-96db-8222e2bbb032 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:19.243420 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb511d91-de3b-4921-88aa-da95d196e37a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=673801e7-27c1-44ad-bc6a-66fccef69f67,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:19.246253 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-cb511d91-de3b-4921-88aa-da95d196e37a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:19.248253 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-cb511d91-de3b-4921-88aa-da95d196e37a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:19.249285 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-cb511d91-de3b-4921-88aa-da95d196e37a admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/673801e7-27c1-44ad-bc6a-66fccef69f67 HTTP/1.1" status: 204  len: 168 time: 0.1645207
May 31 16:31:19.588141 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 39970) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:31:19.637174 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-d32c57ea-c927-4111-b73f-5bfebc23eda1 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=aaf741cd215644308245542578883a8a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0478010
May 31 16:31:19.639531 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.wsgi [-] (91764) accepted ('10.222.0.43', 39974) {{(pid=91764) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 31 16:31:19.690921 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:19.697445 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-77ba4cac-2079-4ec1-81a4-6bb563b59b76 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:19.723980 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-77ba4cac-2079-4ec1-81a4-6bb563b59b76 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:19.777296 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-77ba4cac-2079-4ec1-81a4-6bb563b59b76 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16435301'] for security_group, after_delete {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:19.781031 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-8221d3c6-24fe-496f-a5d8-4035c543608d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 31 16:31:19.794176 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77ba4cac-2079-4ec1-81a4-6bb563b59b76 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=44f20ef9-5785-4c7b-aba1-676892713d2e,revision_number=None']} {{(pid=91764) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 31 16:31:19.799526 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG oslo_concurrency.lockutils [None req-77ba4cac-2079-4ec1-81a4-6bb563b59b76 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 31 16:31:19.801444 dv-cinder-793814-1-iscsi neutron-server[91764]: DEBUG neutron_lib.callbacks.manager [None req-77ba4cac-2079-4ec1-81a4-6bb563b59b76 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91764) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:19.802588 dv-cinder-793814-1-iscsi neutron-server[91764]: INFO neutron.wsgi [None req-77ba4cac-2079-4ec1-81a4-6bb563b59b76 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/44f20ef9-5785-4c7b-aba1-676892713d2e HTTP/1.1" status: 204  len: 168 time: 0.1621895
May 31 16:31:35.026785 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-cb2c7867-8c7c-497c-a7c5-b2e2565eac90 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:37.915838 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:38.247151 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-91ff9a6f-8506-4a2f-af2a-33037654ba20 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:39.195621 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:40.901374 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:31:41.167968 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:31:49.722153 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:32:05.020004 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-5f0f776a-1b25-498d-ad0d-9c37aa2c33d6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:32:07.917901 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:32:08.248796 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-ce4b353a-79c5-4873-93fb-e7adf92a972b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:32:09.198060 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:32:10.904289 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:32:18.166633 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:32:19.736568 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:32:35.024507 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-1d5ed46c-f6e2-40ec-b866-8e08ce7b6e30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:32:37.920115 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:32:38.254107 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-de9e3bb0-dac4-4988-84f1-ba6fdefd65eb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:32:39.235951 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:32:40.908212 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:32:49.736255 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:32:55.165117 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:33:05.026956 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-13c45a88-2f24-4c2c-b8bc-416cdd6a8436 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:33:07.923871 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:33:08.257378 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af7b3e44-b8d2-41e1-bb4e-490d98d585ac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:33:09.203863 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:33:10.910627 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:33:19.752419 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:33:32.165141 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:33:35.028592 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-18967049-ed35-4c70-8225-a0f9e08af4b9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:33:37.926709 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:33:38.260562 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-a089ae2a-d77c-4863-a21d-1f980fc9f82d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:33:39.206521 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:33:40.913204 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:33:49.751032 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:34:05.030993 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-ebce4a63-7d97-4c18-9658-06edae118a1d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:34:07.929804 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:34:08.264628 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-b73b1f40-97e0-4f0d-83a9-c41b05d764c3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:34:09.165014 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:34:09.208990 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:34:10.915461 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:34:19.748563 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:34:35.032834 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-d9544a6f-bda5-40df-86f0-6311c554f1bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:34:37.931385 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:34:38.266744 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-1a0d4bba-5b35-48df-ba3e-49d8b8a8337c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:34:39.212178 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:34:40.920385 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:34:46.164415 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:34:49.748136 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:35:05.034981 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-636a0acc-1ec3-48a5-8d7e-261aa03da290 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:35:07.935001 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:35:08.268358 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-d4e7c277-31d4-415e-b235-e7122c641867 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:35:09.215000 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:35:10.922925 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:35:19.749435 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:35:23.163829 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:35:35.036037 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-245c0f03-83e4-4e45-8232-3e5ec7ae34c8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:35:37.937135 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:35:38.270758 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-f8bde70a-d342-4b6c-9c75-63204753e0f0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:35:39.218665 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:35:40.925441 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:35:49.766865 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:36:00.163892 dv-cinder-793814-1-iscsi neutron-server[91766]: DEBUG neutron.db.agents_db [None req-20de515b-3f1c-4091-b1c9-b6a07dab6774 None None] Agent healthcheck: found 6 active agents {{(pid=91766) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 31 16:36:05.037512 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-8cd638e4-7a09-4b96-8ce9-252b3bd8b482 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:36:07.938409 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-45c75e2e-5d72-4eac-b235-9c683a401ea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:36:08.272620 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-3ab53cf8-9436-4bb9-8966-048b55051edb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:36:09.221762 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-0b2f48c9-d6e0-4bb6-a8e1-2329b0412df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:36:10.928557 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-af211773-6b34-4f40-a9e6-486499e1b121 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 31 16:36:19.779853 dv-cinder-793814-1-iscsi neutron-server[91765]: DEBUG neutron_lib.callbacks.manager [None req-2a5e71dd-2059-470b-afc2-c60165e4346d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732784586222', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-990633'] for agent, after_update {{(pid=91765) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}